Senior Data Pipeline Engineer

Job description

Job Title: Senior Data Pipeline Engineer Job Category: Engineering: Time Type: Full time: Minimum Clearance Required to Start: TS/SCI with Polygraph Employee Type: Regular: Percentage of Travel Required: None: Type of Travel: None: - * * The Opportunity: Join our dynamic team as we revolutionize enterprise security with our Secure the Enterprise initiative. We are seeking a skilled professional to help us transition from a manual system security evaluation and authorization process to a cutting-edge model that leverages automation, streamlined processes, continuous monitoring, and comprehensive network data gathering. This role offers an exciting opportunity to make a significant impact on our organization's security posture and operational efficiency. Responsibilities: Data Integration: Seamlessly integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch. NiFi Cluster Optimization: Enhance NiFi cluster architecture, performance tuning, and data pipeline strategies. Dataflow Design: Design, implement, and troubleshoot dataflows using Apache NiFi, including processors, connections, and templates. Cloud Deployment: Deploy and manage NiFi in cloud environme...