Software Engineer Project Intern (Model Infrastructure) - 2026 Start (BS/MS)

Job description

About the Team The TikTok Model Infrastructure team is the core engine powering the world’s most engaged "For You" feed. We focus on the engineering efficiency and architectural evolution of recommendation models at an unprecedented scale. As we lead the industry’s shift toward LLM2Rec and Large Recommendation Models (LRM), our mission is to build ultra-high-performance infrastructure that bridges the gap between massive data scale and extreme algorithmic complexity. We tackle the industry's most demanding "frontier" challenges: managing Petabyte-scale distributed embedding states, optimizing thousand-node GPU clusters, and perfecting real-time Sparse/Dense streaming. Our work ensures that models with hundreds of billions of dense parameters—on par with the world's largest LLMs—can operate with millisecond-level latency. We are seeking Software Engineering Interns to join the Model Infra team to redefine the performance boundaries of recommendation systems. In this role, you will focus on the efficiency of the entire model lifecycle. You will work on the convergence of generative AI and recommendation architecture, optimizing everything from the raw throughput of multi-billion para...