Principal Data Engineer

Job description

Description JOB SUMMARY: As a senior technical leader, you will architect, build, and operationalize modern data products on Azure + Databricks, lead major migrations, and raise engineering velocity and quality through AI-assisted development. You’ll mentor engineers, establish patterns/standards, and ensure solutions are secure, governed, and supportable in an enterprise healthcare environment. -Lead AI-assisted development adoption for data engineering: define when/how to use approved coding assistants to accelerate delivery while maintaining code quality and auditability. -Establish an AI engineering playbook: prompt patterns, review checklists, “definition of done,” and guardrails (e.g., no sensitive data in prompts; ensure generated code is tested, reviewed, and observable).-Enable “agentic” workflows where appropriate (e.g., repo-aware assistants, MCP-connected tooling) to improve developer productivity and reduce time-to-debug. -Own reference architectures for: medallion/lakehouse patterns, batch + streaming ingestion, CI/CD deployment patterns, Unity Catalog governance, and operational monitoring. -Run a structured mentorship program: pairing, design reviews, code reviews,...