This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Infrastructure System Engineer based in India.

This role offers the chance to build and operate large-scale infrastructure supporting advanced AI training and inference workloads.
You’ll engineer systems that manage thousands of GPUs with a strong focus on automation, reliability, performance, and availability.
The position goes beyond traditional infrastructure operations, emphasizing software-driven solutions and autonomous systems.
You’ll develop platforms that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal manual intervention.
Your work will span hardware, networking, storage, distributed systems, and AI workloads.
You’ll collaborate closely with infrastructure, hardware, networking, platform, and AI engineering teams to solve complex systems challenges.
It’s an ideal environment for an automation-focused engineer who enjoys building intelligent infrastructure at significant scale.

n

Accountabilities:





• Design and build fleet automation systems capable of provisioning, validating, deploying, upgrading, repairing, and retiring GPU clusters with minimal human intervention.

• Develop AI infrastructure agents that automate deployment workflows, investigate root causes, triage incidents, and support autonomous remediation.

• Build fleet intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance.

• Develop predictive capabilities that identify potential infrastructure failures before they affect customers or workloads.

• Build software and automation systems that maximize GPU availability, utilization, performance, and reliability across large accelerator fleets.

• Create automated validation frameworks for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage systems, and distributed AI workloads.

• Develop int

📌 AI Infrastructure System Engineer (India)
🏢 Jobgether
📍 India