About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India's full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India's leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role
This is an intellectually demanding role. The Data Scientist anchors the evaluations function for this vertical — designing, building, and maintaining evaluation frameworks that measure model and system quality in operational context. You are not running standard benchmarks. You are building domain-specific eval harnesses for high-stakes use cases where a wrong answer carries real consequences.
You will work closely with the MLOps Engineer, the PM, and the deployment team.



The evaluations you design are the mechanism by which the team determines whether what we've built is good enough to deploy — and whether it stays valuable after deployment.

What You'll Do
• Design and build evaluation frameworks for Sarvam's AI outputs across domain-specific requirements: document comprehension, command summarisation, geospatial reasoning, enterprise workflow automation, and others as they emerge
• Define quality metrics in collaboration with domain experts and clients; translate operational requirements into measurable, defensible signals
• Run structured evaluation cycles pre- and post-deployment; build dashboards that surface model quality in production
• Identify failure modes, edge cases, and distribution shifts — with the bias of someone looking for what's wrong, not confirming what's right
• Collaborate with the MLOps Engineer to operationalise eval pipelines — automated, triggered by deployment events, versioned, and reproducible
• Build and manage domain-specific datasets for fine

📌 Data Scientist (Bengaluru)
🏢 SARVAM
📍 Bengaluru