Software Engineer II

Job description

Description Markon’s partner company is seeking a Software Engineer II to design, develop, and maintain scalable data workflows and automation pipelines using Apache Airflow. This role supports data engineering, analytics, and operational use cases by building reliable, secure, and production-ready workflow orchestration solutions. The ideal candidate will collaborate closely with data engineers, platform teams, and stakeholders to ensure data pipelines are efficient, observable, and aligned with enterprise standards. Responsibilities: - Design, develop, and maintain data workflows using Apache Airflow - Build and manage complex DAGs, operators, sensors, and scheduling logic - Develop scalable automation pipelines to support data engineering and analytics initiatives - Integrate workflows with distributed data processing engines such as Apache Spark - Collaborate with cross-functional teams to ensure workflows are secure, efficient, and production-ready - Troubleshoot and optimize pipeline performance and reliability - Automate manual processes using Bash and Python - Support containerized deployments using Docker, containerd, or Podman - Maintain version control and code quality u...