Senior Consultant - Public Cloud and Hybrid AI Infrastructure

Capability

Public Cloud and Hybrid AI Infrastructure

Level

Senior Consultant

Primary focus

NVIDIA GPU-based AI infrastructure and AI data centres

Deployment model

Private cloud, public cloud and hybrid AI infrastructure

Role mandate The Senior Consultant will architect, engineer and operate production NVIDIA GPU infrastructure on public cloud and connect it with private AI estates. The role covers GPU landing zones, cluster fabrics, cloud-native orchestration, performance, security, reliability and AI infrastructure FinOps.

Key responsibilities

- Design GPU landing zones, accounts/subscriptions/projects, network topology, private connectivity, identity, encryption, policy and observability.
- Select NVIDIA GPU instances and cluster patterns for distributed training, fine-tuning, batch inference and low-latency serving.
- Engineer cloud GPU clusters using managed Kubernetes or HPC schedulers, placement/topology controls and high-performance network adapters.
- Design high-throughput object, file and block storage, data ingestion, checkpointing, cache and cross-region/data-centre movement patterns.
- Build hybrid connectivity and workload portability between private GPU clusters and public cloud.
- Implement Terraform, image pipelines, CI/CD/GitOps, autoscaling, quota automation, reservations/capacity blocks and environment promotion.
- Integrate cloud ML services where appropriate while retaining infrastructure controls for custom NVIDIA-based workloads.
- Establish GPU availability, utilization, token, latency, throughput, reliability and cost observability.
- Implement AI infrastructure FinOps covering commitments, spot/preemptible usage, idle detection, rightsizing, storage/egress and showback/chargeback.
- Engineer security for images, drivers, model artifacts, secrets, endpoints, data residency and software supply chain.




- Build and automate assigned infrastructure components and independently own engineering stories.
- Execute validation, benchmarking, troubleshooting, upgrades and operational handover.
- Create as-built documentation, test evidence, runbooks and reusable modules.

Required experience and skills
- Typically 6-10 years in infrastructure, DevOps, SRE, HPC or platform engineering, including hands-on GPU or accelerated-computing experience.
- Strong implementation, automation, testing, troubleshooting and technical-documentation skills.
- NVIDIA GPU architecture and systems including DGX/HGX or equivalent certified platforms.
- GPU cluster design across compute, high-speed network, storage, control plane and management plane.
- AI workload characteristics across distributed training, fine-tuning, RAG, batch inference, real-time inference and HPC.
- Kubernetes/OpenShift and/or Slurm; GPU scheduling, partitioning, quotas, isolation and multi-tenancy.
- Linux, containers, CUDA ecosystem, NCCL, drivers, firmware and GPU observability fundamentals.
- Security, resilience, capacity, performance, automation and day-2 operations for production AI infrastructure.
- Deep expertise in at least one of AWS, Microsoft Azure or Google Cloud and working awareness of the other platforms.
- Experience with cloud GPU capacity, high-performance networking, managed Kubernetes/HPC, IaC and cloud cost optimization.

Preferred profile
- Experience in hyperscalers, GPU cloud/neocloud providers, GCC cloud platform teams or large enterprise cloud AI estates.
- Skilled cloud, NVIDIA, Kubernetes, Terraform, network or FinOps certification.
- Experience with hybrid AI, sovereign cloud, reserved GPU capacity and production-scale inference.

Success outcomes
- Production-ready, secure and scalable GPU infrastructure.
- High GPU utilization, predictable application performance and reduced time to onboard AI workloads.
- Reliable capacity expansion, platform automation and measurable cost/energy efficiency.
- Strong client satisfaction, delivery quality and reusable engineering accelerators.

📌 AI Infrastructure (Bengaluru)
🏢 Deloitte Shared Services India
📍 Bengaluru