26 Oct
|
HCLTech
|
Bengaluru
Location: Noida or Bengaluru
About the Role
We believe small, well-distilled models can match much larger systems at a fraction of the cost — and that belief is only as valuable as the distillation pipeline behind it. As a Distillation Engineer, you'll build and run that pipeline.
What You'll Do
Design and run teacher-student distillation pipelines to produce small, effective models
Implement quantization-aware training and model compression techniques
Manage student-model refresh cycles as teacher models and training data improve
Evaluate distilled-model quality against both public benchmarks and real production tasks
Collaborate with our evaluation and data teams on synthetic data generation for distillation
What You'll Bring
5+ years of relevant experience in machine learning engineering or applied research
Hands-on experience with knowledge distillation and teacher-student training
Experience with quantization-aware training and model compression techniques
Proficiency in PyTorch and Python
Comfort iterating quickly on model quality tradeoffs under compute constraints
Education
Master's or PhD in Machine Learning, Computer Science, or a related quantitative field.
Nice to Have
A master's or PhD in Machine Learning, ideally with a publication record in model compression or effective inference
Experience building small, production-quality language models
📌 Ml Engineer Model Distillation/knowledge Distillation Bengaluru
🏢 HCLTech
📍 Bengaluru