JobMesh

Data Platform Engineer - AWS

Volkswagen Group Digital Solutions [Portugal] · Lisbon, PT

You’ll be focused in • Creating and manage data pipeline architecture for data ingestion, pipeline setup and data curation • Experiencing working with and cr...

Job description

You’ll be focused in: In order to succeed, you’ll need - Creating and manage data pipeline architecture for data ingestion, pipeline setup and data curation - Experiencing working with and creating cloud data solutions - Assembling large, complex data sets that meet functional/non-functional business requirements - Implementing the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Pyspark, SQL and AWS big data-technologies - Building analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics - Manipulating data at scale: getting data in a ready-to-use state in close alignment with various business and Spoke stakeholders - Bachelor's degree in computer science, software engineering, or comparable work experience - At least 5 years of experience as a data engineer or software developer, preferably in the automotive sector. - Experience with AWS CDK Cloud Development Kit - Experience with CI/CD pipelines - Experience Python, SQL (Any other OOP language is also valuable), PySpark (preferably) or Spark Kn...