Role Overview

As a Sports Domain Expert, you will evaluate and improve Large Language Models by applying your expertise across global sports, leagues, athletes, tournaments, rules, statistics, and analytics. You will design challenging prompts, assess AI-generated responses, identify knowledge gaps and reasoning issues, and contribute to benchmark datasets and adversarial test cases.

Key Responsibilities

- Create advanced prompts covering global sports, leagues, athletes, tournaments, rules, statistics, and analytics.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback with reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and documentation.

Job Requirements

Minimum Qualifications

- Master s degree or higher in a discipline related to Sports.
- 3+ years of professional, research,



or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.

Preferred Qualifications

- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.

Work Details

- Location: Kolkata, India
- Employment Type: Contractual
- Work Mode: WFH
- Leave Perks: This contractual engagement does not include paid medical leave or other paid leave benefits.
- Work Schedule: Full-time, 40 hours per week, with at least 4 hours of PST overlap.
- Start Immediate

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 LLM Evaluation Professional (Kolkata)
🏢 Fusion CX
📍 Kolkata