Head of Operations, Voice of IndiaJosh Talks · Voice of India · Full time · Gurgaon

About Josh TalksJosh Talks helps enterprises, governments and not-for-profits make better decisions about which AI services to buy and deploy, through independent, human-powered evaluation. Voice of India, its evaluation platform, sits at the centre of this work.
Josh Talks began as one of India's largest regional-language storytelling platforms, and the reach it built over a decade now underpins its work in AI.

About Voice of IndiaVoice of India is India's first human-powered multimodal evaluation platform, built by Josh Talks and co-developed with IIT Madras. It measures how well AI models work for the people of India, in their own languages and on the tasks they care about.
Our founding principle is that AI should be judged by people, not by other AI systems. Every ranking is backed by independent human evaluation, a published methodology and transparent evidence, rather than vendor claims or automated judges.
Live leaderboards today cover speech to text, text to speech,



speech to speech and text to image, across 15 Indian languages. Leaderboards for language models, translation, legal tasks, document OCR, video and AI agents are in development. What sets the platform apart:
• Independent human judgment. Evaluations are carried out by people under blind conditions. Model names remain hidden until a judgment is recorded, the order of answers is randomised, and no vendor evaluates its own model.
• Built for procurement. Results are designed to inform procurement and deployment decisions. Scores are broken down by language, domain, geography and use case.
• Academically rigorous. Every benchmark follows a published protocol with sound statistics and reproducible experiments.
• Built from how India speaks. The speech to text benchmark uses 536 hours of unscripted telephone conversations from 36,691 speakers across 139 regional clusters. Its test set is closed, so models cannot be tr

📌 Head of Operations, Voice of India (Gurugram)
🏢 Josh Talks
📍 Gurugram