Job Title: Senior Machine Learning Engineer (6+ Years Experience)
Location: Mumbai, Bengaluru
Employment Type: Full time

Role Overview

We are looking for a Senior Machine Learning Engineer to lead the development and optimization of Small Language Models (SLMs) for enterprise clients. You will drive complex model fine-tuning, knowledge distillation. As a senior technical contributor, you will mentor junior engineers, guide model selection and GPU optimization decisions, and ensure high-quality delivery across multiple concurrent client engagements.

Key Responsibilities
Lead and execute complex fine-tuning and knowledge distillation pipelines for Small Language Models (1B-13B parameters) including Llama, Mistral, Phi, Qwen, and Gemma model families.
Architect and implement production-grade RAG systems with vector database integration for domain-specific enterprise applications.
Drive model selection decisions by evaluating performance, licensing, and deployment requirements across client use cases in FinTech, Healthcare, Insurance, and Retail verticals.




Collaborate with MLOps engineers to optimize inference performance, including quantization (INT8/INT4), latency tuning, and GPU resource utilization on AWS infrastructure (EC2, SageMaker, EKS).
Design and generate high-quality synthetic datasets for model training, addressing data privacy constraints and domain-specific requirements.
Provide technical mentorship to mid-level ML engineers — guiding experimentation, reviewing code, and establishing ML best practices across the pod.
Evaluate emerging SLM architectures, fine-tuning techniques, and optimization frameworks to maintain client's competitive edge in the market.
Support pre-sales activities by contributing to technical assessments, model benchmarking, and solution design for client proposals.
Contribute to the development of pre-built domain-specific SLMs for priority verticals, enabling rapid deployment for future customers.
Stay updated

📌 Senior Machine Learning Engineer Bengaluru
🏢 Awign Expert
📍 Bengaluru