Director | Hybrid cloud | Bengaluru | Engineering | Hybrid Cloud Engineering
- Job requisition ID : 111027
- Location: Bengaluru
- Entity: Deloitte Touche Tohmatsu India LLP

The team

The team must do much more than keep the wheels turning; it is the engine that drives functional excellence and the enabler of innovation and long-term growth.

Key responsibilities
- Own end-to-end architecture across NVIDIA GPU compute, CPU/DPU, management nodes, control plane, high-speed fabrics, storage, backup and security.
- Design and deploy DGX/HGX or NVIDIA-certified GPU clusters and select fit-for-purpose GPU platforms for training, fine-tuning, visualization, batch inference and real-time inference.
- Architect InfiniBand, Spectrum-X Ethernet and RoCE networks, including topology, rail optimization, congestion control, OOB management, telemetry and performance engineering.
- Define high-performance file and object storage architectures covering checkpointing, data staging, metadata, throughput, IOPS, resiliency and data lifecycle requirements.




- Engineer AI data-centre requirements covering rack layout, GPU density, power, cooling, cabling, physical resilience, capacity expansion and DCIM/monitoring integration.
- Implement Kubernetes/OpenShift and/or Slurm-based platforms, including GPU scheduling, NVIDIA GPU/Network Operators, MIG, quotas, tenancy, workload isolation and policy enforcement.
- Integrate and operationalize NVIDIA AI Enterprise, CUDA, NCCL, NIM, NeMo, Triton, DCGM and approved AI model/runtime services.
- Establish automated provisioning, firmware and driver lifecycle management, image management, validation, burn-in, acceptance testing and performance benchmarking.
- Operate the platform using SRE principles, with comprehensive observability, incident and problem management, capacity planning, patching, disaster recovery and security controls.
- Optimize GPU utilization, job throughput, tokens per second, workload performance, energy efficiency and cost per

📌 Director | Hybrid cloud | Bengaluru | Engineering | Hybrid Cloud Engineering
🏢 Deloitte
📍 Bengaluru