Senior ETL Software Developer

Job description

Description : This is a brand new, high-priority project. This team will be responsible for aggregating data sources to create a clear picture of what infrastructure was requested, what infrastructure was deployed, and proactively alert on any discrepancies. The team's application will then be used by subject matter experts to investigate, create, and iterate on best practices and deployment rules. Then, the team will proactively identify and alert when requested or provisioned infrastructure breaks those best practices and rules. This team must interact with many stakeholders from across the organization and iterate as frequently as possible. As a Software Engineer focusing on streaming analytics and ETL, you will design pipelines that transform infrastructure data into actionable insights. Successful candidates will have skills allowing them to also contribute to the team in other ways, such as subject matter expertise, database design, full stack development, etc. Responsibilities: · Build streaming data pipelines (Kafka, Python, Java) to process infrastructure data. · Develop ETL workflows to reconcile requested vs. realized infrastructure. · Ensure scalable and reliable data i...