Software Engineer – Distributed Systems & Apache Kafka
NewGen Technologies Inc. · Springfield, Virginia, US
Candidates must be willing to work in SCIF daily or as needed. The anticipated end for this work is the end of July, with expectation of mod/additional fundi...
Job description
Candidates must be willing to work in SCIF daily or as needed. The anticipated end for this work is the end of July, with expectation of mod/additional funding through 2027. Responsibilities: - Design, build, and maintain highly scalable Apache Kafka streaming systems to support near real-time data ingestion and processing across distributed environments - Define and develop comprehensive technical onboarding requirements for new data types, ensuring seamless integration and compatibility with existing streaming infrastructure - Develop and maintain robust metrics reporting for Kafka services, including end-to-end latency, throughput, and operational status to drive performance visibility and proactive issue resolution Requirements: - TS/SCI CI Poly Clearance with VA Customer eligibility and SBU/SECNet/COE accounts - DoD 8140 Compliance - 5+ years of professional software engineering experience with cloud-first development approach - 5+ years of hands-on experience with AWS CDK for Infrastructure as Code - 5+ years of advanced Python development experience - 4+ years of data engineering experience - 3+ years building complex, reusable CDK constructs and stacks - Proficiency in asyn...