Senior Applied ML Engineering | Platform Co-Ownership | Production Excellence

About the role
Lead production ML engineering across Recommendations, Ads, Search, and recent initiatives. Own model deployment end to end; co-own Inference Engine feature development with the platform team. Partner with Scientists, who own model behavior and business outcomes, and ensure production models meet agreed latency, reliability, quality, and cost goals.

Key responsibilities
Inference Engine development and model deployment
• Co-own the Inference Engine roadmap and feature delivery with the platform team: translate Data Science needs into requirements, and contribute to design, implementation, testing, documentation, integration, reliability, and adoption.
• Own model deployment end to end: register artifacts and metadata, version models, validate in staging, coordinate API integration, promote to production, configure defaults, run shadow tests or go-live, and manage monitoring and rollback.
• Set readiness gates for dependencies, feature access, request and response contracts,



compute and storage, and load-test latency, throughput, errors, and cost.
• Build reusable real-time and batch serving patterns for feature retrieval, model composition, and pipeline orchestration.

GPU-based inference and deep learning training
• Lead GPU-backed deep learning and language-model inference; tune runtimes, batching, concurrency, precision, VRAM, and CPU-to-GPU transfers for latency, throughput, quality, and cost.
• Build GPU training and fine-tuning workflows with efficient data loading, mixed precision, multi-GPU execution, checkpointing, and capacity planning; support small language model adaptation and distillation.
• Benchmark utilization, VRAM, p95/p99 latency, throughput, and H100-class versus current GPU options; inform model, capacity, and cost decisions.

Reliability and technical leadership
• Own SLOs, dashboards, alerts, and runbooks for service health, features, models, latency,

📌 Machine Learning Engineer II (Bengaluru)
🏢 Nykaa
📍 Bengaluru