Data Engineer III

Job description

About Agile Defense At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next. Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests. Requisition #: 1533: Job Tittle: Data Engineer III Location: Doral, FL Required Clearance: Top Secret Job Description: Build Scalable Data & ML Infrastructure - Design and implement medallion architecture (Bronze/Silver/Gold) using Databricks or reliable data processing and ML model training - Develop automated data pipelines that process structured and unstructured data from multiple sources into analytics-ready formats - Create robust ETL/ELT workflows using Apache Spark and modern data engineering practices for both batch and streaming data - Build and maintain data quality monitoring and validation systems across the entire data and M...