Data Engineers - Senior #IN1265

Job description

Lead projects for design, development and maintenance of a data and analytics platform. Effectively and efficiently process, store and make data available to analysts and other consumers. Work with key business stakeholders, IT expects and subject-matter experts to plan, design and deliver optimal analytics and data science solutions. Design and automate deployment of our distributed system for ingesting and transforming data from various types of sources. Design and implement framework to continuously monitor and troubleshoot data quality and data integrity issues. Implement data governance processes and methods for managing metadata, access, retention to data for internal and external users. Design and provide guidance on building reliability, efficient, scalable and quality data pipelines with monitoring and alter mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages. Design and implement physical data models to define the database structure, optimizing database performance through efficient indexing and table relationships. Participate in optimizing, testing, and troubleshooting of data pipelines. Design, develop and operate large scale data st...