Job title: GenAI Specialist – Rating

Job Location: Hyderabad

Job Type: Full time

Key Responsibilities
Evaluate AI-generated responses using defined quality rubrics.
Assess factuality, grounding, relevance, completeness, helpfulness, clarity, safety, and instruction following.
Identify AI hallucinations, factual errors, and unsupported claims.
Validate geographic, local, and Maps/POI-related information.
Evaluate routes, locations, distances, local businesses, and navigation-related responses.
Distinguish between minor and critical defects.
Provide transparent, evidence-based justifications for ratings.
Escalate ambiguous or policy-sensitive cases when required.
Participate in calibration exercises and maintain consistency across evaluation tasks.
Provide feedback to improve AI evaluation guidelines and processes.

Required Skills
Understanding of Generative AI / LLM behavior.




Experience or understanding of AI response evaluation, data annotation, content evaluation, or quality analysis.
Strong analytical and critical-thinking skills.
Ability to identify hallucinations and unsupported information.
Excellent written English and reading comprehension.
Good understanding of geography, navigation, maps, POIs, and local search.
Robust attention to detail and evidence-based decision-making.

Good to Have
Experience with AI/LLM evaluation or annotation platforms.
Search and fact-verification experience.
Knowledge of local businesses and travel/navigation terminology.
Basic Excel/Google Sheets skills.
Basic SQL knowledge.
Exposure to Jira, documentation tools, or AI evaluation platforms.

📌 Content Moderator Secunderabad
🏢 Global Infovision Private
📍 Secunderabad