Reports to: Head of Product
Team: Product - a horizontal role supporting whichever pod needs rigorous
analysis in a given week (Observability, Workflows, Graph Agents, Infra), with
work assigned and prioritized weekly rather than owned by a single pod

ABOUT BOLNA

Bolna is a YC-backed voice AI orchestration platform built for the Indian market
- powering multilingual, vernacular voice agents (Hindi, Hinglish, Tamil, and
10+ languages) at sub-500ms latency across collections, recruitment, sales, and
e-commerce use cases. We're an orchestration layer, not a model company: our
moat is outcome-labeled vernacular data, a rigorous evaluation infrastructure,
and a growing taxonomy of how Indian enterprise voice AI actually fails in
production.

WHY THIS ROLE EXISTS

Product decisions at Bolna increasingly hinge on rigorous, code-mixed-aware data
analysis - and not just one kind. On one side there's model/eval rigor: LLM
benchmarking for post-call intelligence, ASR/WER evaluation, inter-rater
reliability on human-labeled calls, routing/latency economics. On the other




there's product and growth insight: understanding where self-serve users drop
off in their journey, what patterns emerge across lakhs of monthly calls, which
use cases and configs are actually working. Both currently sit with the Head of
Product alongside strategy and roadmap ownership. We need a dedicated analyst to
own the execution and the recurring cadence across both - freeing product
leadership to act on findings rather than produce them.

WHAT YOU'LL DO

MODEL & EVALUATION ANALYSIS

* LLM & model benchmarking: Run structured comparisons across model providers
(e.g. Sarvam, DeepSeek, Gemini, Claude variants) for tasks like post-call
extraction and LLM-as-judge scoring - evaluating cost, accuracy, fill rate,
and TTR, with particular attention to Hinglish and code-mixed content.
* Evaluation infrastructure: Build and maintain LLM-as-judge pipelines (e.g.
using DeepEval), design and track eval metrics, and

📌 Product Analyst (Bengaluru)
🏢 Bolna
📍 Bengaluru