Principal Software Engineer - AI/ML (Ireland)
Red Hat · IE
Principal Software Engineer to work on cutting-edge AI/ML applications and agent systems, leveraging modern inference platforms to build production-ready pro...
Job description
Principal Software Engineer to work on cutting-edge AI/ML applications and agent systems, leveraging modern inference platforms to build production-ready prototypes. You will contribute to upstream communities like vLLM, TGI, PyTorch, and OpenVINO while building innovative applications that demonstrate the capabilities of next-generation AI/ML systems. The ideal candidate is energized by working concurrently on a wide variety of projects, independently as well as within a team environment. What you will do: - Build high-quality, high-performing AI/ML applications and agent systems using modern inference platforms for multi-modal and distributed model serving - Apply and optimize inference techniques including KV cache management, model quantization, and distributed serving to production workloads - Contribute to upstream inference runtime communities such as vLLM, TGI, PyTorch, OpenVINO, and related projects - Build multi-modal AI applications integrating vision, language, and other modalities - Provide technical leadership and coordination across multiple stakeholders and engineering teams - Apply a growth mindset by staying current with rapid advancements in AI/ML inference techn...