Data Engineer - Remote

Job description

City/State Virginia Beach, VA Work Shift: First (Days) Overview: Sentara is hiring a Data Engineer! This is a fully remote position. Overview: We are looking for a Data Engineer to support a modern data platform built on Databricks. This role will focus on building scalable data pipelines, supporting a metadata-driven ingestion framework, and ensuring data quality and governance are embedded into the platform. Key Responsibilities: - Develop and maintain data pipelines using PySpark and Databricks - Work within a metadata-driven ingestion framework to onboard new datasets - Implement data quality checks and validation rules within pipelines - Support ingestion from file-based sources and ingestion tools (e.g., Fivetran) - Handle schema changes, incremental loads, and file processing patterns - Contribute to data governance practices including tagging, metadata, and lineage - Troubleshoot and resolve pipeline failures and performance issues - Collaborate with architects and stakeholders on data onboarding and requirements - Follow and contribute to coding standards, reusable components, and best practices Education: - Experience in lieu of a Bachelor’s Degree - 3+ years of relevant...