Data Engineer, Specialist

Job description

Role Summary The Data Engineer, Senior Specialist is responsible for designing, developing and optimizing data pipelines and architectures to support scalable and efficient data processing. This role involves working with complex datasets, integrating multiple data sources and ensuring high data quality and reliability. Responsibilites: 1. Develop and maintain efficient ETL (Extract, Transform, Load) pipelines that ingest, process and transform large datasets from diverse sources. 2. Build and manage data storage solutions using relational and non-relational databases, ensuring high availability, performance and scalability. 3. Work with APIs, third-party data sources and internal databases to create unified datasets that provide actionable insights for business stakeholders. 4. Partner with business intelligence analysts, data scientists and software engineers to design and implement data-driven solutions that meet business requirements. 5. Design optimized data schemas and structures that support analytical workloads and improve query performance. 6. Leverage orchestration tools like Apache Airflow or Prefect to automate ETL workflows and improve operational efficiency. 7. Provid...