Staff Software Engineer, LLM Serving and GPU Performance, Google Distributed Cloud

Job description

Minimum qualifications: - Bachelor's degree or equivalent practical experience. - 8 years of experience in software development. - 5 years of experience testing and launching software products. - 5 years of experience with performance, large scale systems data analysis, visualization tools, or debugging. - 3 years of experience with software design and architecture. - 3 years of experience in low-level systems optimization, including performance tuning for GPU or TPU accelerators or high-performance distributed AI serving infrastructure. Preferred qualifications: - Master’s degree or PhD in engineering, computer science, or a related technical field. - 8 years of experience with data structures and algorithms. - 3 years of experience in a technical leadership role leading project teams and setting technical direction. - 3 years of experience working in a matrixed organization involving cross-functional or cross-business projects. - 3 years of experience leading the architecture and multi-quarter technical roadmap for AI inference or training systems, focusing on hardware-software co-design. - 3 years of experience implementing optimization techniques, such as quantization, speculat...