JobMesh

Senior Data Engineer - AI Infrastructure

Microsoft · Mountain View, California, US

Overview We are building a large-scale data platform that transforms raw system logs into high-quality, structured datasets used for experimentation and anal...

Job description

Overview We are building a large-scale data platform that transforms raw system logs into high-quality, structured datasets used for experimentation and analytics. The platform processes terabytes to petabytes of data daily and serves as a foundational asset for multiple teams. This Senior Data Engineer - AI Infrastrucute role focuses on designing and implementing data pipelines, ensuring correctness, and building scalable data models. You will work closely with data scientists and platform engineers to ensure that data is accurate, reliable, and usable for downstream decision-making. We are looking for engineers who care deeply about data correctness, understand how systems behave at scale, and can translate complex data into well-structured, reliable datasets. Responsibilities: Build and maintain data models that accurately represent underlying system behavior and business logic Ensure high standards of data correctness, completeness, and consistency across datasets Develop validation, monitoring, and alerting mechanisms to detect data quality issues Partner with data scientists to support experimentation and analytics use cases Collaborate with platform engineers to ensure effic...