Company Description:
MillionLogics is a trusted Oracle Partner and global leader in IT solutions, with operations in London, UK, and a development hub in Hyderabad, India. Specializing in innovative and scalable services, MillionLogics empowers enterprises through data & AI, cloud solutions, IT consulting, and custom application development. With a team of 85+ AI/ML experts, we deliver tailored solutions that foster digital transformation and operational excellence.
We're committed to client success. We blend world-class technical expertise with strategic insight to deliver results.
Role Overview
We are seeking a highly qualified Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your subject matter expertise will help ensure the reliability, consistency, and quality of AI evaluation data across a broad range of academic, research, and industry disciplines.
Offer details:
Mode of work: Remote
Employment Type: Contract
Commitments Required: Full time. 40 hours per week with at least 4 hours PST overlap
Start Date: Immediate
Years of Experience: 3+
Minimum Qualifications
- Master's degree or higher in a relevant academic or professional discipline.
- Minimum 3 years of professional, research, teaching, or industry experience in your area of expertise.
- Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
- Excellent written English communication and analytical skills.
- Strong attention to detail and the ability to identify factual, logical, and contextual errors.
Key Responsibilities
- Review and validate domain-specific prompts within your area of expertise.
- Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and review guidelines.
- Escalate ambiguous or complex cases when necessary and document review findings.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
How to Apply: Please apply here on LinkedIn or share your updated CV with us at
[email protected] with the email subject - Domain Experts
📌 Domain Expert (India)
🏢 Millionlogics
📍 India