About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.;
Role Overview
We are seeking a highly qualified Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your subject matter expertise will help ensure the reliability,
consistency, and quality of AI evaluation data across a broad range of academic, research, and industry disciplines.
Key Responsibilities
- Review and validate domain-specific prompts within your area of expertise.
- Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide transparent, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and review guidelines.
- Escalate ambiguous or complex cases when necessary and document review findings.
- Collaborate with project managers and AI teams to continuously
📌 Domain Expert Reviewer (India)
🏢 Turing
📍 India