Senior AI Evaluation Analyst
Location: Kochi
Experience: 5–8 Years
Role Overview
Seeking an experienced and detail-oriented professional to join its Machine Learning Science team, supporting the development and improvement of AI-powered travel products. The team works on conversational AI agents that help travelers discover options, compare products, plan trips, and receive assistance throughout their travel journey.
You will play a key role in evaluating the quality, accuracy, relevance, and reliability of AI-generated responses against established guidelines and quality metrics. You will analyze evaluation results, identify recurring errors and quality gaps, and translate findings into actionable insights that help improve AI agent performance.
This role requires a strong foundation in data annotation, quality evaluation, analytical problem-solving, and guideline-based decision-making. The position is suited to professionals who enjoy hands-on evaluation and analysis of AI outputs rather than traditional business reporting or dashboard development.
Ideal Candidate Profile
The ideal candidate is an experienced, hands-on professional who combines solid evaluation and quality assurance skills with analytical thinking. They should be comfortable reviewing large volumes of information, applying structured guidelines, identifying recurring quality issues, and converting observations into meaningful insights.
Candidates with experience in AI evaluation, data annotation, content quality, search relevance, or similar quality-focused roles are encouraged to apply. Direct experience with LLMs or conversational AI is an advantage but is not mandatory for candidates with strong transferable experience.
Key Responsibilities
• Evaluate AI-generated responses from conversational agents against predefined guidelines, evaluation criteria, and quality standards.
• Perform and review data annotation, labelling, and classification to assess the accuracy, relevance, complete
📌 Senior AI Evaluation Analyst (Kochi)
🏢 Naviq
📍 Kochi