Senior Researcher - LLM System Architecture

Job description

Huawei is a leading global information and communications technology (ICT) solutions provider. Driven by a commitment to sound operations, ongoing innovation, and open collaboration, we have established a competitive ICT portfolio of end-to-end solutions in telecom and enterprise networks, devices, and cloud technology and services. Our ICT solutions, products, and services are used in more than 170 countries and regions, serving over one-third of the world's population. With 180,000 employees, Huawei is committed to enabling the future information society, and building a Better Connected World. Huawei's Switzerland Research Centre in Zurich is responsible for advanced technical research, architecture evolution design and strategic technical planning on computer architecture. We are currently looking for Researchers of our new Computer Architecture Innovation Lab. Job Responsibilities: Efficient LLM inference engine design: architect and implement solutions to improve the efficiency of open-source (e.g., vllm/sglang) and proprietary (e.g., Mindspore) LLM inference engine, such as quantization, sparse attention, and KV cache reuse Hardware-Software Co-Design: Design efficient kernel...