Reports to: Head of Product
Team: Product - a horizontal role supporting whichever pod needs rigorous analysis in a given week (Observability, Workflows, Graph Agents, Infra), with work assigned and prioritized weekly rather than owned by a single pod

About Bolna

Bolna is a YC-backed voice AI orchestration platform built for the Indian market - powering multilingual, vernacular voice agents (Hindi, Hinglish, Tamil, and 10+ languages) at sub-500ms latency across collections, recruitment, sales, and e-commerce use cases. We're an orchestration layer, not a model company: our moat is outcome-labeled vernacular data, a rigorous evaluation infrastructure, and a growing taxonomy of how Indian enterprise voice AI actually fails in production.

Why this role exists

Product decisions at Bolna increasingly hinge on rigorous, code-mixed-aware data analysis - and not just one kind. On one side there's model/eval rigor: LLM benchmarking for post-call intelligence, ASR/WER evaluation, inter-rater reliability on human-labeled calls, routing/latency economics.



On the other there's product and growth insight: understanding where self-serve users drop off in their journey, what patterns emerge across lakhs of monthly calls, which use cases and configs are actually working. Both currently sit with the Head of Product alongside strategy and roadmap ownership. We need a dedicated analyst to own the execution and the recurring cadence across both - freeing product leadership to act on findings rather than produce them.

What you'll do

Model & evaluation analysis
- LLM & model benchmarking: Run structured comparisons across model providers (e.g. Sarvam, DeepSeek, Gemini, Claude variants) for tasks like post-call extraction and LLM-as-judge scoring - evaluating cost, accuracy, fill rate, and TTR, with particular attention to Hinglish and code-mixed content.
- Evaluation infrastructure: Build and maintain LLM-as-judge pipelines (e.g. using DeepEval), design and track eval metrics, and r

📌 Product Analyst (Bengaluru)
🏢 Bolna
📍 Bengaluru