Databricks Pipeline Architect

Job description

ECS is seeking a Databricks Pipeline Architect to work remotely . Please Note: This position is contingent upon additional funding. ECS is seeking a Databricks Pipeline Architect to support the design, implementation, and long-term operation of Databricks within a complex Government enterprise environment. This role will work closely with various stakeholders during initial implementation and will support with data engineering projects as Databricks is rolled out within the environment. The ideal candidate will bring strong Databricks and AWS experience, familiarity with architecting solutions for scale and governance, and is comfortable integrating Databricks with other data platforms. Key responsibilities include: - Lead data engineering efforts within Databricks to include pipeline development within Databricks on AWS in an enterprise environment - Provide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse - Support the integration of Databricks with existing analytics platforms and metadata solutions - Serve as a tec...