Role Overview

As a Sports Domain Expert, you will evaluate and improve Large Language Models by applying your expertise across global sports, leagues, athletes, tournaments, rules, statistics, and analytics. You will design challenging prompts, assess AI-generated responses, identify knowledge gaps and reasoning issues, and contribute to benchmark datasets and adversarial test cases.

Key Responsibilities
Create advanced prompts covering global sports, leagues, athletes, tournaments, rules, statistics, and analytics.
Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
Develop benchmark datasets and adversarial test cases.
Provide evidence-based feedback with reliable references.
Collaborate with AI researchers to improve model performance.
Maintain high annotation quality and documentation.

Job Requirements

Minimum Qualifications
Master s degree or higher in a discipline related to Sports.
3+ years of professional, research,



or teaching experience.
Excellent written English and analytical skills.
Solid attention to detail.

Preferred Qualifications
Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
Published research, industry recognition, or teaching experience is a plus.
Ability to work independently and provide objective, evidence-backed reviews.

Work Details
Location: Kolkata, India
Employment Type: Contractual
Work Mode: WFH
Leave Perks: This contractual engagement does not include paid medical leave or other paid leave perks.
Work Schedule: Full time, 40 hours per week, with at least 4 hours of PST overlap.
Start Immediate

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Llm Evaluation Professional Kolkata
🏢 Fusion CX
📍 Kolkata