Software Engineer, ARC Team

Job description

Scale AI is seeking a highly skilled and motivated Software Engineer, ARC (Architecture, Reliability, & Compute) to join our dynamic Public Sector Engineering team. As a part of this team, you will build and maintain internal CLIs/tools that standardize testing, deployment, and environment management. You'll own the model inference layer-managing networking, debugging latency, and tracking pricing/usage metrics for AI models. And you'll work with Product to build integration tests that catch issues early, shifting the focus from "infra-only debugging" to prevent failures upstream. You will: - Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure. - Own services or systems and define their long-term health goals, while also improving the health of surrounding components - Improve our high engineering standards, tooling, and process - Collaborate with cross-functional teams to define and execute the vision for backend solutions, ensuring they meet the unique needs of government agencies operating in secure environments. - Participate actively in customer engagements, working closely with stakehol...