Senior Data Engineer (Azure & Databricks)
Emergent Software · Bloomington, Minnesota, US
** This is a 6+ month contract with our client based out of Bloomington, MN. This is a hybrid role, working in office Tuesday/Thursday. Candidates must be ab...
Job description
** This is a 6+ month contract with our client based out of Bloomington, MN. This is a hybrid role, working in office Tuesday/Thursday. Candidates must be able to work in the US without sponsorship.** We’re looking for a Senior Data Engineer with strong Azure experience, especially in Azure Databricks, Delta Lake, and SQL, to build and scale a medallion-based data platform. This role focuses on designing high‑performance, governed data pipelines using PySpark, SQL, and Databricks tools to integrate data from Azure systems, SQL Server Managed Instance, and third‑party sources, while partnering closely with analytics teams and business stakeholders. Experience or strong interest in supporting AI/ML use cases is highly valued, with financial‑services experience considered a plus but not required. Responsibilities: Design, develop, and optimize data pipelines in Azure Databricks using PySpark and SQL, applying Delta Lake and Unity Catalog best practices. Build modular, reusable libraries and utilities within Databricks to accelerate development and standardize workflows. Implement Medallion architecture (Bronze, Silver, Gold layers) for scalable, governed data zones. Integrate external...