JobMesh

Data Engineer

Volkswagen Group Digital Solutions [Portugal] · Lisbon, PT

You’ll be focused in • Creating and managing data pipeline architecture for data ingestion, pipeline setup and data curation based in AWS; • Experiencing wor...

Job description

You’ll be focused in: of data sources using PySpark, Hive, Iceberg, SQL and AWS big data-technologies efficiency, and other key business performance metrics stakeholders In order to succeed, you’ll need - Creating and managing data pipeline architecture for data ingestion, pipeline setup and data curation based in AWS; - Experiencing working with and creating cloud data solutions. - Assembling large, complex data sets that meet functional/non-functional business requirements - Implementing the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety - Building analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational - Manipulating data at scale: getting data in a ready-to-use state in close alignment with various business and - Bachelor's degree in computer science, software engineering, or comparable work experience - At least 5 years of experience as a data engineer or software developer, preferably in the automotive sector. - Strong experience Data Lake, Data Warehouse, RDS architectures knowledge - Experience Python, SQL (Any other OOP language is also valuable), PySpark (pref...