Job title: GenAI Specialist – Rating

Job Location: Hyderabad

Job Type: Full-Time

Key Responsibilities

- Evaluate AI-generated responses using defined quality rubrics.
- Assess factuality, grounding, relevance, completeness, helpfulness, clarity, safety, and instruction following.
- Identify AI hallucinations, factual errors, and unsupported claims.
- Validate geographic, local, and Maps/POI-related information.
- Evaluate routes, locations, distances, local businesses, and navigation-related responses.
- Distinguish between minor and critical defects.
- Provide clear, evidence-based justifications for ratings.
- Escalate ambiguous or policy-sensitive cases when required.
- Participate in calibration exercises and maintain consistency across evaluation tasks.
- Provide feedback to improve AI evaluation guidelines and processes.

Required Skills

- Understanding of Generative AI / LLM behavior.




- Experience or understanding of AI response evaluation, data annotation, content evaluation, or quality analysis.
- Strong analytical and critical-thinking skills.
- Ability to identify hallucinations and unsupported information.
- Excellent written English and reading comprehension.
- Good understanding of geography, navigation, maps, POIs, and local search.
- Robust attention to detail and evidence-based decision-making.

Good to Have

- Experience with AI/LLM evaluation or annotation platforms.
- Search and fact-verification experience.
- Knowledge of local businesses and travel/navigation terminology.
- Basic Excel/Google Sheets skills.
- Basic SQL knowledge.
- Exposure to Jira, documentation tools, or AI evaluation platforms.

📌 Content Moderator (Secunderabad)
🏢 Global Infovision Private
📍 Secunderabad