27 Sep
|
ElevateCareer.AI
|
Hyderabad
27 Sep
ElevateCareer.AI
Hyderabad
WE ARE HIRING FOR TECH MAHINDRA
GENAI SPECIALIST – RATING
Tech Mahindra
Location: Hyderabad
About This Role
Join Tech Mahindra as a GenAI Specialist – Rating and be at the forefront of AI quality assurance! You'll evaluate AI-generated responses against gold-standard benchmarks, directly shaping the datasets that train and improve next-generation AI models. Your keen eye for detail and analytical thinking will ensure cutting-edge language models deliver accurate, safe, and helpful responses to millions of users worldwide.
Why Join Tech Mahindra?
✓ Be part of a Fortune 500 company driving AI innovation
✓ Work on cutting-edge generative AI evaluation projects
✓ Contribute directly to training datasets for advanced LLMs
✓ Career growth in the rapidly expanding AI/ML field
✓ Collaborative environment with talented cross-functional teams
✓ Competitive compensation & benefits package
Key Responsibilities
- Evaluate AI-generated responses using standardized, rigorous evaluation rubrics
- Assess factual accuracy of geographic and local information with precision
- Verify responses are properly grounded in available map and place data
- Evaluate responses on: factuality, grounding, helpfulness, completeness, relevance, clarity, safety, and instruction following
- Identify hallucinations and unsupported claims in AI outputs
- Distinguish between critical and minor defects in responses
- Provide detailed, evidence-based justification for every rating decision
- Escalate ambiguous or policy-sensitive cases appropriately
- Maintain consistency across evaluation tasks and maintain high quality standards
- Participate in calibration exercises to align evaluation standards across teams
- Contribute valuable feedback to improve evaluation guidelines and processes
What We're Looking For
Essential Requirements:
- Work Experience: 0–3 years in data annotation, content evaluation, technical writing, AI/LLM evaluation, or related field
- Educational Background: Bachelor's degree in Linguistics, English, Computer Science, Humanities, or related field (or equivalent practical experience)
- Excellent Written English – Strong reading comprehension and ability to interpret nuanced prompts
- Critical Reasoning: Evidence-based decision making with meticulous attention to detail
Core Competencies:
- Generative AI Evaluation: Understanding of LLM behavior, prompt-response evaluation, hallucination detection, and response quality assessment
- Analytical Thinking: Strong critical reasoning, pattern recognition, and attention to detail
- Maps Knowledge: Geographic reasoning, navigation concepts, POIs (Points of Interest), local search behavior, and route interpretation
- Language Skills: Excellent written English, reading comprehension, ability to interpret nuanced prompts
Secondary Skills (Preferred):
- Search verification techniques
- Knowledge of local businesses and travel/navigation terminology
- Familiarity with Maps products
- Basic data annotation experience
- Spreadsheet proficiency (Excel)
Nice-to-Have Skills:
- SQL (basic)
- Annotation platforms
- Jira
- Documentation tools
- AI evaluation platforms
Success Measures ✓ Rating consistency across evaluations
✓ High calibration accuracy
✓ Low disagreement rates with team benchmarks
✓ Superior annotation quality
✓ Strong productivity metrics
✓ Minimal audit defect rates
What Makes You Stand Out
If you're analytical, detail-oriented, and passionate about AI quality—someone who can spot nuances others miss and articulate why an AI response succeeds or falls short—this is your chance. Help shape the future of AI by ensuring every model learns from the highest-quality human feedback. Your precision and judgment directly impact millions of users globally.
Ready to advance AI responsibly? Apply now and join the GenAI revolution at Tech Mahindra!
Pay: ₹350,000.00 - ₹450,000.00 per year
Work Location: In person
📌 GenAI Specialist - Rating (Hyderabad)
🏢 ElevateCareer.AI
📍 Hyderabad