Senior AI/ML Engineer (Voice Intelligence & Speech AI)

Role Overview

We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in Automatic Speech Recognition (ASR), Text-to-Speech (TTS), and Natural Language Understanding (NLU). The ideal candidate will lead the development of our Voice AI framework, specifically focusing on building an agentic platform for intelligent customer interactions and call analysis. You will be responsible for the end-to-end lifecycle of speech models, from fine-tuning Large Language Models (LLMs) for conversational intent extraction to deploying real-time voice synthesis and transcription services in a production workplace.

Key Responsibilities

- Model Development & Fine-tuning: Lead the selection and fine-tuning of Speech-to-Text and LLM architectures to achieve >95% precision in multi-lingual conversation analysis across 12+ Indian regional languages.
- End-to-End Voice Pipelines: Design and optimize real-time and batch processing workflows to extract structured parameterssuch as call disposition, payment commitments (PTP), and sentimentfrom complex financial collection and support calls.
- Agentic Orchestration: Develop and maintain a runtime agent core with sub-agents for transcription, intelligence extraction, and decision logging to automate loan processing and verification.
- Voice Synthesis & Personality: Implement sophisticated voice bot personalities using advanced TTS (e.g., ElevenLabs) to manage interruptions, language switching, and empathetic customer engagement.
- Performance Evaluation: Conduct rigorous evaluation of audio quality and transcription accuracy (Word Error Rate, F1-score) to ensure high-reliability performance across production batches.
- Integration & Deployment: Collaborate with engineering to integrate third-party ASR/TTS services and deploy high-performance REST APIs within AWS (EKS/ECS) environments.




- Required Skills & Qualifications

- Experience: 2-4 years of hands-on experience in AI/ML engineering, with a proven track record in Speech AI, Voice Intelligence, or specialized conversational NLP.
- Speech Expertise: Demonstrated experience with ASR models (e.g., Whisper, Scribe V2) and TTS platforms for both real-time and batch processing.
- LLM & NLP Knowledge: Proficiency in fine-tuning LLMs (Llama, BERT) for information extraction from transcripts and managing multi-turn conversational state.
- Technical Stack: Strong proficiency in Python, including ML frameworks such as PyTorch or TensorFlow, and experience with audio processing libraries.
- Production Knowledge: Familiarity with MLOps, CI/CD pipelines, Docker, Kubernetes, and cloud platforms like AWS for deploying scalable voice microservices.

Education: Bachelor’s or Master’s degree in Computer Science, AI, Mathematics, or a related field.

Disclaimer:
This job description is intended to outline the general nature and key responsibilities of the position. It is not intended to be an exhaustive list of all duties, responsibilities, or qualifications associated with the role. The responsibilities and qualifications described may be subject to change, and other duties may be assigned as needed. Employment is at-will, meaning the employee or the employer may terminate the employment relationship at any time, with or without cause, and with or without notice.

Data Utilization Disclaimer:
By applying for this position, you acknowledge and agree that any personal data you provide may be used for recruitment and employment purposes. The data collected will be stored and processed in accordance with our privacy policy and applicable data protection laws. Your information will only be shared with relevant internal stakeholders and will not be disclosed to third parties without your consent, unless required by law.

📌 Senior AI/ML Engineer (Voice Intelligence & Speech AI) (Karnataka)
🏢 Krazy Bee Services
📍 Karnataka