JobMesh

Member of Technical Staff, Applied AI Engineer

Microsoft · Mountain View, California, US

Overview We’re hiring a Applied AI Engineer to join a fast‑moving, high‑ownership team building next‑generation AI assistant and productivity capabilities. T...

Job description

Overview We’re hiring a Applied AI Engineer to join a fast‑moving, high‑ownership team building next‑generation AI assistant and productivity capabilities. This role blends LLM product engineering, evaluation science, hillclimbing, and internal tool building with the pace and creativity of a startup. You’ll work across the entire lifecycle of features from early prototypes to production‑grade systems and help define how millions of users interact with AI. Responsibilities: LLM Feature & Agent Development Design and ship LLM‑powered assistant features , including conversational flows, agentic behaviors, retrieval pipelines, and multimodal interactions. Evaluation, Hillclimbing & Quality Systems Build and maintain evaluation frameworks for correctness, safety, grounding, and UX quality. - Build prompt architectures , system instructions, and orchestration logic that ensure reliability, grounding, and personality consistency. - Prototype new capabilities rapidly and iterate based on user signals and evaluation data. - Run hillclimbing loops across prompts, models, and tool‑use strategies to continuously improve assistant performance. - Analyze failure modes, design mitigations, and dr...