ROLE OVERVIEW
Lead the engineering platform and operating model for transformer-based foundation models trained on large-scale customer-event data. This role owns the architecture for cloud infrastructure, orchestration, release controls, observability and scalable execution across pretraining, fine-tuning and scoring. It combines hands-on system design with project management, cross-functional leadership and accountability for secure, reliable and cost-conscious delivery.
KEY RESPONSIBILITIES:
- Define the target architecture and engineering roadmap for transformer training, evaluation, registry, deployment and scoring workflows across cloud environments.
- Lead orchestration design for long-running, dependency-heavy and restartable pipelines, including distributed GPU workloads and controlled promotion between environments.
- Establish infrastructure patterns for compute, storage, networking, IAM, secrets, encryption, environment isolation, backup and disaster recovery.
- Own CI/CD, Infrastructure as Code, testing strategy, artefact management, model lineage, approval gates and rollback mechanisms.
- Design observability for pipeline health, model and data drift, resource utilisation, latency, failures and cloud spend; define measurable service objectives.
- Partner with data scientists to optimise throughput and reliability without compromising validated model behaviour, reproducibility or governance evidence.
- Lead engineers through system-design reviews, coding standards, incident analysis, documentation, mentoring and technical decision-making.
- Create delivery plans, estimate capacity, manage risks and dependencies, and coordinate cloud, cyber security, data, validation and business stakeholders.
- Provide concise updates to senior stakeholders and drive production-readiness reviews, release decisions and post-deployment improvement plans.
REQUIRED SKILLS AND EXPERIENCE:
Programming: Solid Python and SQL skills, with production-quality coding,
testing, packaging and Git-based development practices
Pipeline orchestration: Hands-on experience designing and operating training, evaluation, batch-scoring and deployment pipelines using tools such as Airflow, Kubeflow, Azure ML, AWS SageMaker or Vertex AI
Cloud infrastructure: Practical knowledge of cloud compute, storage, networking, IAM, secrets management and GPU-enabled workloads on Azure, AWS or GCP
MLOps: Experience with Docker, CI/CD, artefact and model registries, MLflow or Weights & Biases, configuration management and reproducible environments
Transformer operations: Understanding of distributed or multi-GPU training, checkpointing, mixed precision, data loading, model serving and performance optimisation for transformer-based models
Reliability: Experience with monitoring, logging, alerting, lineage, rollback, cost controls, security and production-support practices
Architecture and leadership: Proven system-design depth for ML platforms and experience leading engineering workstreams, technical reviews, delivery planning and stakeholder engagement
GOOD TO HAVE:
- Infrastructure as Code using Terraform, Bicep or CloudFormation and Kubernetes-based platform engineering.
- Distributed training and compute using PyTorch Distributed, DeepSpeed, Ray, Spark or managed cloud equivalents.
- Model-serving optimisation, autoscaling, feature stores, event streaming and low-latency inference patterns.
- Security and governance for regulated financial-services workloads, including auditability and segregation of duties.
- Cloud architecture, DevOps, Kubernetes or machine-learning certifications.
QUALIFICATIONS:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science or another relevant technical discipline.
- 4–8 years of ML engineering, cloud platform, DevOps or data-platform experience, including production ML systems.
Demonstrated ownership of cloud and MLOps architecture plus leadership of complex cross-functional deliveries.
📌 Senior Machine Learning Engineer (Gurugram)
🏢 EXL
📍 Gurugram