JobMesh

Scientific and Technical Service Specialist - Freelance AI Trainer Project

Invisible Technologies · US

Project Overview We are sourcing independent Scientific and Technical Service Specialists to provide their expertise for an AI benchmark evaluation project.

Job description

Project Overview We are sourcing independent Scientific and Technical Service Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade scientific analyses, technical reports, and STEM-focused deliverables, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training. Project Deliverables & Scope: Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include: - Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to scientific research, engineering, and technical services. - Rubric Development: Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score. - Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinemen...