JobMesh

Staff+ Software Engineer, Backend and Infra

Haize Labs · New York City, New York, US

Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the rel...

Job description

Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them. We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production. This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries. In this role, you will: - Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more - Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooli...