Data Engineer, Enterprise Data, Analytics and Innovation
Vaniam Group · US
Data Engineer, Enterprise Data, Analytics and Innovation, Digital Innovation What You'll Do Are you passionate about building robust data infrastructure and...
Job description
Data Engineer, Enterprise Data, Analytics and Innovation, Digital Innovation What You'll Do: Are you passionate about building robust data infrastructure and enabling innovation through engineering excellence? As our Data Engineer, your goal is to own and evolve the foundation of our data infrastructure. You will be central in ensuring data reliability, scalability, and accessibility across our lakehouse and transactional systems. This role is ideal for someone who thrives at the intersection of engineering and innovation, ensuring our data platforms are robust today while enabling the products of tomorrow. A Day in the Life: Lakehouse and Pipelines: - Design, build, and operate reliable ETL and ELT pipelines in Python and SQ - Manage ingestion into Bronze, standardization and quality in Silver, and curated serving in Gold layers of our Medallion architecture - Maintain ingestion from transactional MySQL systems into Vaniam Core to keep production data flows seamless - Implement observability, data quality checks, and lineage tracking to ensure trust in all downstream datasets Data Modeling and Governance: - Develop schemas, tables, and views optimized for analytics, APIs, and prod...