Senior Software Test Engineer - AI Agent

Job description

What's the role? We are looking for a highly skilled Senior Test Automation Engineer to ensure the quality, reliability, and safety of next-generation agentic AI systems for the logistics industry. In this role, you will own test automation, reliability validation, scenario simulation, and AI-specific evaluation pipelines . You will work with complex, non-deterministic systems involving LLMs, agent workflows, and real-world logistics constraints such as routing, time windows, and geospatial data. This is not a traditional QA role. You are expected to define what to test and how to test it , build intelligent testing systems, and proactively identify risks in AI-driven behavior. What You’ll Do: Design and build automated testing frameworks for backend services, APIs, and AI-driven logistics systems Develop evaluation pipelines for LLM systems (quality, safety, regression detection) Create scenario simulations covering routing constraints, time windows, capacities, and geospatial edge cases Define testing strategies for non-deterministic systems using statistical and tolerance-based validation Validate geospatial data, routing logic, and integrations with HERE and external APIs Build...