Job Summary

To own the end-to-end operational health, reliability, and performance of our AI/ML platform running across Azure, AWS, and On-Premises GPU environments. The ideal candidate will have deep expertise in maintaining GPU-accelerated infrastructure, AI/ML application stacks, and hybrid-cloud deployments while ensuring maximum uptime, scalability, and security.

You will play a critical role in supporting production AI workloads, troubleshooting complex platform issues, and continuously optimizing the infrastructure that powers our AI applications (LLMs, ML models, inference services, RAG pipelines, etc.).

Key Responsibilities

Platform Operations & Maintenance

Manage day-to-day operations, monitoring, and maintenance of the AI Platform across Azure, AWS, and on-premises GPU clusters.
Ensure high availability, reliability, and performance of AI/ML applications and services (training, inference, fine-tuning, RAG pipelines).
Perform proactive health checks, capacity planning, patching, and lifecycle management of infrastructure components.
Handle incident management,



root cause analysis (RCA), and problem resolution within defined SLAs.

GPU Infrastructure Management

Maintain and troubleshoot GPU nodes (NVIDIA A100, H100, V100, L40S, etc.), including driver installations, CUDA updates.
Optimize GPU utilization, workload scheduling, and resource allocation across multi-tenant environments.
Manage GPU clusters using Kubernetes (with GPU operators) or similar orchestrators.

Cloud & Hybrid Setting Management

Administer AI/ML workloads on Azure ML, AWS SageMaker, EKS/AKS, EC2/Azure VMs, and on-prem Kubernetes/OpenShift clusters.
Manage container-based deployments using Docker, Kubernetes, Helm, and GPU-enabled runtimes.
Configure and maintain networking, storage (NFS, Blob, S3), and IAM across hybrid environments.

AI Application Support

Support production AI applications including LLM serving, MLflow, Kubeflow, Ray, and similar platforms.
Deploy, upgrade

📌 Senior Platform Engineer (Chennai)
🏢 Standard Chartered India
📍 Chennai