Tech Lead Manager, Commerce AI, Quality and Evals

Job description

Minimum qualifications: - Bachelor’s degree or equivalent practical experience. - 8 years of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript). - 7 years of experience leading technical project strategy, ML design, and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning). - 5 years of experience in a technical leadership role. - 5 years of experience in a people management or team leadership role. - 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision). Preferred qualifications: - 5 years of experience working in a complex, matrixed organization. - 5 years of experience in engineering leadership, particularly within rapidly scaling enterprise SaaS or AI product teams. - Experience designing telemetry, observability, and data pipeline solutions to track real-time application metrics and user behavior. - Experience leveraging user simulation (e.g., Monte Carlo runs) and deterministic checks for complex AI evaluation. - Experience with prompt engineering, Ret...