08 Aug
|
People Prime Worldwide
|
India
08 Aug
People Prime Worldwide
India
About Company:Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018. It helps companies connect with remote software developers using AI-powered vetting and matching technology. Originally branded as the “Intelligent Talent Cloud, "enabled companies to “spin up their engineering dream team in the cloud” by sourcing and managing vetted global talent.In recent years, they have evolved to support AI infrastructure and AGI workflows, offering services in model training, fine-tuning, and deployment—powered by their internal AI platform, ALAN, and backed by a vast talent network. They reported $300 million in revenue and reached profitability. Their growth is driven by demand for annotated training data from AI labs, including major clients like OpenAI, Google, Anthropic, and Meta.Job Description:Job Title: Domain Expert ReviewerLocation: Pan IndiaExperience: 3+ yrs.Employment Type: Contract to hireWork Mode: RemoteNotice Period: - Immediate joinersRoles & Responsibilities:Role Overview:We are seeking a highly qualified Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your subject matter expertise will help ensure the reliability, consistency,
and quality of AI evaluation data across a broad range of academic, research, and industry disciplines.Key ResponsibilitiesReview and validate domain-specific prompts within your area of expertise.Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines.Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.Ensure prompts are challenging, relevant, and aligned with project objectives.Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.Maintain consistency across reviews by following established quality standards and review guidelines.Escalate ambiguous or complex cases when necessary and document review findings.Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.Minimum QualificationsMaster's degree or higher in a relevant academic or skilled discipline.Minimum 3 years of professional, research, teaching, or industry experience in your area of expertise.Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.Excellent written English communication and analytical skills.Strong attention to detail and the ability to identify factual, logical, and contextual errors.
📌 Domain Expert Reviewer (India)
🏢 People Prime Worldwide
📍 India