Role Overview

We are looking for an experienced qualified to evaluate AI-generated responses for conversational AI agents used in travel-related products. The role focuses on assessing response accuracy, relevance, completeness, and quality to improve AI performance.

Key Responsibilities

- Evaluate AI-generated responses against predefined guidelines and quality standards.
- Perform data annotation, labeling, classification, and quality reviews.
- Identify incorrect, misleading, irrelevant, or incomplete responses and potential AI hallucinations.
- Analyze evaluation data to identify recurring errors, quality gaps, and improvement opportunities.
- Track quality metrics, document findings, and recommend improvements.
- Use Excel/Google Sheets and basic SQL, where applicable, to analyze evaluation data.
- Collaborate with AI and Machine Learning teams to improve conversational AI performance.

Required Skills





- 5–8 years of experience in Data Annotation, AI Evaluation, Content Quality, Search Relevance, or Quality Assurance.
- Strong analytical, problem-solving, and attention-to-detail skills.
- Experience applying evaluation guidelines and quality standards consistently.
- Proficiency in Excel or Google Sheets.
- Good written communication and documentation skills.
- Understanding of quality metrics and data analysis.

Good to Have

- Exposure to Generative AI, LLMs, conversational AI, or AI response evaluation.
- Experience with Human-in-the-Loop (HITL), AI training data validation, or hallucination detection.
- Basic SQL knowledge.
- Experience in travel, hospitality, or search quality evaluation.

Skills:- Data annotation, data labelling and Artificial Intelligence (AI)

📌 Data Annotation (Kochi)
🏢 ThomasMount Consulting
📍 Kochi