Senior Data Engineer

Job description

Senior Data Engineer Location: London: Business Area: Marketing and Public Relations: Ref #: 10051497 Description & Requirements: The Climate Data Utility Tech Team is actively searching for an experienced Senior Data Engineer to play a pivotal role in the design, i mplementation, enhancement, and maintenance of scalable data pipelines for the Net-Zero Data Public Utility. These pipelines are essential for the Utility's mission of providing open and accessible public good data through both the Climate Data Utility website and APIs. A successful candidate will face the challenge of working with data originating from a wide array of sources, each with its own formats, fields, and access protocols. Your responsibiliti es will encompass the full data lifecycle from the extraction of data from sources, transforming it according to source and domain specific business logic, and pushing it through the Utility’s ingestion process. Additionally, you will be expected to implement data quality checks and validation procedures to ensure the accuracy and reliability of the data provided by the Utility. Responsibiliti es: - Design and develop scalable data pipelines using Python to read from API...