Staff Software Engineer, AI

Job description

This is Engineering at Lattice At Lattice, we build software that helps people and organizations thrive. Our AI Engineering team defines how intelligence works across our platform - how AI systems are measured, improved, and trusted in production. This Staff-level role shapes the foundations that determine AI quality, reliability, and impact at scale. What You Will Do: You will architect and scale the infrastructure that powers AI quality, reliability, and reuse across Lattice. AI Evaluation & Quality: - Design and scale an end-to-end AI evaluation framework spanning offline evals, production tracing, and human feedback loops. - Define meaningful performance metrics (task completion, hallucination, response quality, engagement, business impact) and build the datasets and automated scoring systems that prevent regressions. - Identify and quantify the drivers of agent quality improvement and set methodological standards for evaluation across the organization. Agent Architecture & Production Systems: - Architect reusable agent infrastructure (multi-turn workflows, LLM DAGs, recommendation systems, standardized topologies) using LangGraph or comparable frameworks. - Build and scale RAG...