JobMesh

AI Governance & Risk Management - Warsaw - Associate - Software Engineering

Goldman Sachs · Warsaw, Mazovia, PL

As a Senior AI Guardrail Evaluation Expert & Project Manager, you will play a pivotal role in safeguarding the integrity and trustworthiness of our AI system...

Job description

As a Senior AI Guardrail Evaluation Expert & Project Manager, you will play a pivotal role in safeguarding the integrity and trustworthiness of our AI systems. You will lead the charge in evaluating and refining the guardrails that protect our models from generating harmful, biased, or unfaithful content. This is a unique chance to combine your deep technical expertise with your leadership skills, working within a dynamic, hybrid environment to define best practices in AI ethics and safety for the financial industry. You’ll do: - Lead the comprehensive evaluation and continuous refinement of AI guardrails to ensure robust detection and mitigation of harmful content and behaviours. - Develop and improve sophisticated strategies for evaluating guardrails against: - Profane, Toxic, and Adult Content - Bias detection and mitigation in AI outputs - Illegal and Harmful Content generation - Misuse of Personal Data (PII) and other sensitive information - Hallucination and the generation of unfaithful or factually incorrect content - Drive the planning, execution, and meticulous documentation of complex AI guardrail evaluation projects, ensuring adherence to timelines, resources, and qualit...