JobMesh

Databricks Data Engineer

Expleo · London, England, GB

Overview We are expanding our Data Engineering capability to support a growing client data platform built on modern cloud architecture.

Job description

Overview We are expanding our Data Engineering capability to support a growing client data platform built on modern cloud architecture. We are seeking a Databricks Data Engineer to accelerate the ingestion, processing, and transformation of data into a scalable analytics platform, delivering tangible business value at pace. This role will work closely with client stakeholders and internal teams to design, build, and optimise robust data pipelines while contributing to the evolution of an enterprise-grade data platform leveraging industry best practices. Responsibilities: - Design, build, and maintain scalable data pipelines using Databricks (Azure Databricks preferred) - Develop and manage efficient data ingestion frameworks for onboarding diverse data sources - Implement and optimise Delta Lake and Medallion (Bronze/Silver/Gold) architecture - Collaborate with business, analytics, and reporting teams to structure data for optimal consumption - Support the expansion and enhancement of the data platform, focusing on performance, scalability, and reliability - Integrate and process data from multiple sources, including tools such as Qlik Replicate or similar CDC technologies - Apply...