Job Description
Job Title Head of AI Infrastructure Operations

Location:
Chennai, India

About The Role
L&T; Vyoma Cloud is building next-generation AI Cloud powered by NVIDIA accelerated computing infrastructure. As part of our AI Factory initiative, we are deploying one of the country's largest GPU clusters based on NVIDIA architecture, NVIDIA Cloud Partner Reference Architecture (NCP), InfiniBand networking, and high-performance parallel storage. We are looking for an experienced Head – AI Infrastructure Operations to lead the 24x7 operational management of this mission-critical AI infrastructure stack. The role is responsible for ensuring operational availability, performance, capacity, lifecycle management, and service excellence across GPU infrastructure, AI platforms, cloud services, and supporting operational teams. The ideal candidate should possess deep experience in hyperscale cloud operations, AI/HPC infrastructure, incident management, vendor governance, and operational automation.

Key Responsibilities
• Cloud Operations Leadership
• Lead end-to-end operations of L&T; Vyoma AI Cloud infrastructure.
• Own operational readiness for production cloud services.
• Ensure 24x7 service availability, operational stability, and SLA compliance.
• Build and lead Cloud Operations, NOC, and Infrastructure Operations teams.
• Define operational standards, SOPs, and governance processes.
• NVIDIA GPU Infrastructure Operations
• Manage large-scale NVIDIA GPU clusters based on B300/H100/H200 platforms.
• Operate NVIDIA Cloud Partner Reference Architecture (NCP).
• Monitor GPU health, utilization, firmware, driver lifecycle, and cluster availability.
• Coordinate GPU maintenance, hardware replacement, and preventive maintenance.
• Support AI Factory operational readiness and production workloads.
• High Performance Infrastructure Operations Manage Operations Across
• NVIDIA InfiniBand Fabric
• Ethernet Spine-Leaf Network
• Parallel File Systems (PFS)
• Object Storage
• GPU Servers
• CPU Compute Clusters
• Management Network
• AI Infrastructure Platform Ensure high availability and optimal performance of compute, storage, and networking environments. 4 . Monitoring, Incident & Problem Management
• Own enterprise monitoring platforms.




• Build proactive observability dashboards.
• Manage alerts, incidents, escalations, and major incident response.
• Drive Root Cause Analysis (RCA) and preventive actions.
• Improve MTTR and overall service reliability.
• Capacity & Lifecycle Management
• Forecast infrastructure demand and capacity requirements.
• Monitor GPU, compute, storage, network, and power utilization.
• Plan hardware expansion aligned with business growth.
• Manage firmware, BIOS, operating system, driver, and platform updates.
• Maintain asset lifecycle and technology refresh plans.
• Remote Hands & Break-Fix Operations
• Manage onsite Remote Hands operations across data centers.
• Coordinate hardware installation, rack & stack, cable management, and equipment replacement.
• Drive break-fix activities with OEMs within SLA.
• Ensure field execution quality and operational documentation.
• Validate post-maintenance service restoration.
• Vendor & OEM Management Manage Operational Engagement With
• NVIDIA
• Storage OEMs (VAST/DDN or equivalent)
• Network OEMs
• Server OEMs
• Data Center Partners
• AMC Vendors
• Managed Service Partners Responsibilities Include
• Vendor governance
• Escalation management
• Preventive maintenance planning
• Spare inventory management
• Warranty management
• SLA adherence
• Technical reviews
• Patch, Firmware & Platform Updates Own Lifecycle Management Of
• NVIDIA drivers
• CUDA stack
• GPU firmware
• InfiniBand firmware
• Network operating systems
• Storage software
• Linux platforms
• Kubernetes platform
• Security patches Ensure updates are executed through approved change management processes with minimal service disruption.
• Service Operations & ITIL Governance
• Own Incident, Problem, Change, Release, and Availability Management.
• Maintain operational runbooks and knowledge base.




• Drive automation to reduce manual operational effort.
• Ensure audit and compliance readiness.
• Operational Excellence
• Define operational KPIs and service dashboards.
• Improve operational efficiency through automation.
• Conduct regular service reviews.
• Lead continuous improvement initiatives.
• Establish operational maturity aligned with hyperscale cloud standards. Key Success Metrics
• Cloud Platform Availability (>99.99%)
• GPU Cluster Availability
• MTTR & Incident Resolution SLA
• Change Success Rate
• Capacity Utilization Efficiency
• Infrastructure Health Score
• Vendor SLA Compliance
• Security & Patch Compliance
• Customer SLA Achievement
• Operational Automation Coverage Required Qualifications
• Bachelor's or Master's degree in Engineering, Computer Science, or related discipline.
• 18+ years of experience in Cloud Infrastructure or Data Center Operations.
• 8+ years leading enterprise or hyperscale operations teams. Required Technical Expertise Strong operational experience in:
• NVIDIA GPU Infrastructure
• NVIDIA NCP Architecture
• AI/HPC Infrastructure
• InfiniBand Networking
• High Performance Storage (Parallel File Systems)
• Enterprise Linux
• Kubernetes/OpenShift
• VMware/OpenStack (preferred)
• Monitoring & Observability Platforms
• ITIL Service Management
• Automation & Infrastructure-as-Code
• Capacity Planning
• Performance Management Preferred Experience
• Experience operating GPU clusters exceeding 1,000 GPUs.
• Exposure to NVIDIA DGX SuperPOD or AI Factory environments.
• Experience with Parallel File Systems and AI storage platforms.
• Experience in Sovereign Cloud or regulated cloud environments.
• Knowledge of AI infrastructure operations, CUDA ecosystem, and GPU scheduling platforms.
• Experience managing hyperscale cloud operations supporting enterprise AI workloads. Leadership Competencies
• Operational Excellence
• Customer-First Mindset
• Solid Vendor Management
• Data-Driven Decision Making
• Crisis & Major Incident Leadership
• Cross-Functional Collaboration
• Continuous Improvement
• High Ownership & Accountability

📌 Head of AI Infrastructure Operations (Chennai)
🏢 Larsen and Toubro
📍 Chennai