Job Title: Senior Machine Learning Engineer (6+ Years Experience)
Location: Mumbai, Bengaluru
Employment Type: Full time

Role Overview

We are looking for a Senior Machine Learning Engineer to lead the development and optimization of Small Language Models (SLMs) for enterprise clients. You will drive complex model fine-tuning, knowledge distillation. As a senior technical contributor, you will mentor junior engineers, guide model selection and GPU optimization decisions, and ensure high-quality delivery across multiple concurrent client engagements.

Key Responsibilities
- Lead and execute complex fine-tuning and knowledge distillation pipelines for Small Language Models (1B-13B parameters) including Llama, Mistral, Phi, Qwen, and Gemma model families.
- Architect and implement production-grade RAG systems with vector database integration for domain-specific enterprise applications.
- Drive model selection decisions by evaluating performance, licensing, and deployment requirements across client use cases in FinTech, Healthcare, Insurance, and Retail verticals.




- Collaborate with MLOps engineers to optimize inference performance, including quantization (INT8/INT4), latency tuning, and GPU resource utilization on AWS infrastructure (EC2, SageMaker, EKS).
- Design and generate high-quality synthetic datasets for model training, addressing data privacy constraints and domain-specific requirements.
- Provide technical mentorship to mid-level ML engineers — guiding experimentation, reviewing code, and establishing ML best practices across the pod.
- Evaluate emerging SLM architectures, fine-tuning techniques, and optimization frameworks to maintain client's competitive edge in the market.
- Support pre-sales activities by contributing to technical assessments, model benchmarking, and solution design for client proposals.
- Contribute to the development of pre-built domain-specific SLMs for priority verticals, enabling rapid deployment for future customers.
- Stay updated

📌 Senior Machine Learning Engineer (Bengaluru)
🏢 Awign Expert
📍 Bengaluru