About the role
You'll build and optimize the AI systems behind our platform - starting with the real-time conversational engine behind Joy, and extending across the surfaces that surround it: call summarization and analytics, multi-modal orchestration, document intelligence, and computer-use agents. This is a hands-on engineering role at the intersection of applied LLMs, real-time audio, and agentic workflows - where a 200 ms improvement in time-to-first-token is a real, measurable win, and where a document pipeline or a browser agent has to be just as reliable in a clinical, PHI-sensitive setting.

What you'll do
Build and optimize Joy's real-time voice pipeline (streaming STT → LLM → TTS) on a voice AI orchestration framework, targeting sub-second p95 time-to-first-token.
Implement and tune latency techniques: sentence-chunked streaming TTS, speculative tool prefetching, filler speech, parallel tool execution, and prompt caching.
Integrate LLMs for conversational turns - function/tool calling, prompt engineering, structured outputs, and grounded responses.




Develop and improve the RAG layer over vector search: retrieval quality, knowledge-base grounding, and refusal behavior on out-of-scope or clinical questions.
Benchmark models across multiple frontier LLM providers on latency, cost, and quality - and turn results into concrete configuration and routing decisions.
Build and maintain evaluation harnesses covering retrieval metrics and generation metrics (faithfulness, correct-refusal rate, containment).
Integrate telephony and messaging (SIP trunking / SMS via a programmable telephony provider) and coordinate with EHR middleware for appointment and advantages workflows.
Build call summarization that turns raw transcripts into structured post-call notes and extracted fields, and feed the analytics layer that surfaces KPIs like containment rate, resolution, and call quality.
Contribute to the orchestration layer that coordinates AI across modalities (voice, SMS, docum

📌 AI Engineer (Bengaluru)
🏢 VoiceCare AI
📍 Bengaluru