JobMesh

Research Engineer, ML Systems (All Industry Levels)

Character.AI · Redwood City, California, US

and team Joining us as a Research Engineer on the ML Systems team, you’ll be working on cutting-edge ML training and inference systems, optimizing the perfor...

Job description

About the role and team Joining us as a Research Engineer on the ML Systems team, you’ll be working on cutting-edge ML training and inference systems, optimizing the performance and efficiency of our GPU clusters, and developing new technologies that fine-tune leading consumer AI models with a data flywheel, and serve 20K+ QPS in production with LLMs. Your work will directly contribute to our groundbreaking advancements in AI, helping shape an era where technology is not just a tool, but a companion in our daily lives. At Character.AI , your talent, creativity, and expertise will not just be valued—they will be the catalyst for change in an AI-driven future. What you'll do: The ML Systems team is responsible for the research and deployment of systems that efficiently utilize GPU for AI-enabled products. As a research engineer, you will work across teams and our technical stack to improve our training performance and inference runtime. You will get to shape the conversational experience of millions of users per day. Example projects: Write efficient Triton kernels and tune them for our specific models and hardware Develop prefix-aware routing algorithms to improve serving cache hit...