Software Engineer AI Data Platform - CoreAI

Job description

Overview The GenAI Infrastructure and Solutions team is building large-scale GenAI training infrastructure, LLM-based solutions and tools. We provide the infrastructure for teams in CoreAI and other Microsoft Groups to fine-tune LLMs and serve agentic workload for their own scenarios. As a Software Engineer, you will work on the infrastructure and tools to support large scale model fine-tuning, evaluation, and inference. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. This role is targeting an immediate start date. Responsibilities: Collaborates with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models. Designs, builds and improves the services with high scalability and reliability. Contributes to the deployment and monitoring of services in production environments. Pa...