Data Engineer - AWS/Databricks - Mid Level
Acuity, Inc. · Reston, Virginia, US
Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data pl...
Job description
Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization. Why Acuity?: Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. Responsibilities: Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets. Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture. Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligne...