Description
This role is for one of the Weekday's clients
Salary range: Rs 1200000 - Rs 2000000 (ie INR 12-20 LPA)

Experience: 2+ yrs
Location: Bengaluru
Job Type: Full time

We are looking for an AI Product & Evals Analyst to drive evaluation, quality measurement, product analytics, and enterprise reporting for AI-powered voice and conversational systems. This role sits at the intersection of Product, AI Engineering, Data Analytics, and Customer Success, where you will define how AI performance is measured, monitored, and continuously improved.
You will be responsible for building robust evaluation frameworks, analyzing conversational intelligence, creating enterprise-grade dashboards, and delivering actionable insights that enhance AI quality, customer experience, and business outcomes. The ideal candidate combines strong analytical skills with an AI-first mindset and enjoys leveraging modern AI tools, automation workflows, and data-driven decision-making to scale enterprise AI products.

Requirements
Key Responsibilities




- Design and manage AI evaluation frameworks to measure the quality and performance of voice and conversational AI systems.
- Define conversation-level and interaction-level metrics to monitor AI effectiveness, accuracy, and user experience.
- Analyze business KPIs such as automation rates, containment, customer satisfaction, conversion, operational efficiency, and cost optimization.
- Build and maintain enterprise dashboards, reports, and visualizations using modern business intelligence tools.
- Perform data analysis using SQL and Python to identify trends, detect regressions, and generate actionable insights.
- Develop reusable analytics frameworks, reporting models, and self-service intelligence solutions for internal and enterprise users.
- Leverage AI tools, LLMs, and workflow automation to streamline analytics, reporting, and root cause analysis.
- Collaborate with Product, AI Engineering, Customer Success, and Operations teams to improve

📌 AI Product Analyst (Bengaluru)
🏢 Weekday AI
📍 Bengaluru