JobMesh

Software Developer in Test - Vice President

iCapital · Salt Lake City, Utah, US

iCapital is looking to hire a Software Developer in Test to work on the iCapital platform. This individual will bring practical knowledge of agile developmen...

Job description

About the Role iCapital is looking to hire a Software Developer in Test to work on the iCapital platform. This individual will bring practical knowledge of agile development methodologies and engineering best practices. This role will work closely with the Development and Testing team. The ideal candidate is a combination of a hands-on test engineer who has some managerial experience, and who can understand existing automation test frameworks and has an ability to enhance and implement the same and should also be able to work with other engineers and product managers to support feature-based testing. Responsibilities: - Build and implement robust automated test suites for API and backend services. - Design and implement test strategies for AI/ML models and AI enabled in-house applications, including validation of model outputs, prompt behavior, determinism, and regression across releases. - Establish automated evaluation frameworks for AI systems (i.e. accuracy, consistency, hallucination detection, bias, and drift) and integrate them into CI/CD pipelines. - Partner with AI/ML Engineers, Platform teams, and Governance stakeholders to ensure responsible AI practices, including testa...