06 Nov
|
Birdeye
|
Gurugram
About the Role
We are looking for a Senior Voice AI Engineer to build and scale next-generation conversational Voice AI systems. You will work on real-time, low-latency voice pipelines involving Speech-to-Text (STT), Large Language Models (LLMs), Text-to-Speech (TTS), WebRTC, telephony, and streaming infrastructure. You should have hands-on experience building production-grade Voice AI agents using frameworks like Pipecat, LiveKit, or similar real-time communication platforms. This role requires a deep understanding of streaming architectures, WebSockets, voice quality optimization, interruption handling, and scalable backend systems. Responsibilities
• Design and build production-grade Voice AI applications.
• Develop real-time streaming pipelines for voice conversations.
• Integrate STT, LLM, and TTS providers into low-latency conversational systems.
• Build robust WebSocket/WebRTC infrastructure for bi-directional audio streaming.
• Implement interruption handling (barge-in), turn detection, and Voice Activity Detection (VAD).
• Optimize latency across the complete voice pipeline.
• Integrate telephony providers such as Twilio, SIP, or LiveKit Telephony.
• Develop scalable backend services capable of supporting thousands of concurrent voice sessions.
• Design session management, state management, and conversation memory.
• Build monitoring, observability, and analytics for voice conversations.
• Deploy and operate Voice AI infrastructure on Kubernetes and cloud platforms. Required Skills Voice AI
• Strong understanding of conversational Voice AI systems
• Experience building real-time AI voice assistants
• Knowledge of latency optimization techniques
• Understanding of conversational memory and dialogue management Speech Technologies
• Experience with OpenAI Realtime API, ElevenLabs, Deepgram, AssemblyAI, Google Speech, Azure Speech, Amazon Transcribe, Cartesia, or PlayHT
• Streaming STT and TTS
• Voice cloning and adaptive speech
• Speaker diarization
• Custom vocabulary and pronunciation dictionaries Real-Time Communication
• Pipecat
• LiveKit
• WebRTC
• RTP
• SIP
• WebSockets
• Server-Sent Events (SSE) Backend Development
• Python (preferred), FastAPI, AsyncIO
• WebSocket servers, gRPC, REST APIs
• Event-driven architecture
• Redis, Kafka, RabbitMQ
• PostgreSQL, MongoDB, ClickHouse (good to have) Cloud & Infrastructure
• AWS, GCP, or Azure
• Docker
• Kubernetes
• NGINX
• Load Balancers
• Autoscaling
• CI/CD Preferred Experience
• Built production Voice AI products
• Experience with Pipecat in production
• Experience with LiveKit Cloud or self-hosted LiveKit
• Experience with Twilio Voice or SIP infrastructure
• AI phone agents and call centre automation
• Noise suppression (Krisp, DeepFilterNet, RNNoise)
• Experience supporting 1,000+ concurrent voice sessions
• Multilingual Voice AI Qualifications
• Bachelor's or Master's degree in Computer Science or related field from a Tier 1 institute.
• 6-8 years of software engineering experience.
• 3+ years building real-time streaming systems.
• 2+ years working on Voice AI or conversational AI products.
• Solid system design and distributed systems experience.
📌 Senior AI Engineer (Gurugram)
🏢 Birdeye
📍 Gurugram