Data Engineering Manager

Job description

City/State Virginia Beach, VA Work Shift: First (Days) Overview: Overview The Data Engineering Manager is responsible for - Design and build a metadata-driven file ingestion framework on Databricks aligned with medallion architecture - Lead onboarding of datasets using pattern-based ingestion (not one-off pipelines) - Define and enforce data contracts including schema, keys, and data quality rules - Implement scalable ingestion patterns supporting header / no-header / schema evolution scenarios - Drive table-driven configuration model to eliminate dependency on static YAML-based onboarding - Integrate ingestion framework with governance tools (e.g., DataHub) for lineage, discovery, and ownership - Ensure strong data quality, auditability, and observability through centralized logging and control tables - Collaborate with business and source system teams to understand data semantics and define keys - Establish best practices for file ingestion, schema management, and incremental processing - Lead vendor teams to ensure delivery aligns with target architecture and platform standards Education: - BLD - Bachelor's Level Degree in computer science required - 15 years of experience in a...