JobMesh

Senior Data Engineer (Scala Development)

Techstra Solutions · Pittsburgh, Pennsylvania, US

Role Overview We are seeking an experienced Senior Data Engineer with strong Scala development expertise to build and support large-scale data processing sol...

Job description

Role Overview We are seeking an experienced Senior Data Engineer with strong Scala development expertise to build and support large-scale data processing solutions. This role will focus on developing high-performance data pipelines and applications using Spark and the Hadoop ecosystem, supporting critical enterprise data platforms. The ideal candidate brings strong problem-solving skills, a deep understanding of distributed data processing, and an engineering mindset that considers the full lifecycle of code—from design and development through deployment, performance optimization, and long-term production stability. Key Responsibilities: Design, develop, and maintain scalable data pipelines and distributed data processing applications using Scala and Spark. Build and optimize large-scale batch and data processing frameworks within the Hadoop ecosystem. Write efficient and maintainable Scala-based applications for enterprise data platforms. Develop and maintain SQL-based queries and transformations for data processing and validation. Collaborate with data architects, engineers, and business stakeholders to translate business requirements into scalable data solutions. Ensure data pip...