Head Of AI Infrastructure (Bengaluru)

Head Of AI Infrastructure (Bengaluru)

18 Nov
|
TRUGlobal
|
Bengaluru

18 Nov

TRUGlobal

Bengaluru

Head of AI Infrastructure Engineering, Cloud & Infrastructure Services (CIS) TRUGlobal | Bengaluru | Full time TRUGlobal is building AI-led infrastructure solutions for enterprise clients, and we are hiring a hands-on engineering leader to build them, take them to production and grow the team. You will report to the Chief Delivery Officer, Infrastructure & Cloud Services. What you will do
• Design, build and take AI infrastructure solutions from concept to production for enterprise clients (AIOps, private LLM and RAG platforms, GPU infrastructure).
• Run model serving, vector stores, orchestration, capacity and cost on cloud and on-premises GPUs.
• Set up LLMOps and MLOps: CI/CD for models and agents, evaluation, monitoring and guardrails.
• Design autonomous actions with clear guardrails, approvals and rollback, and integrate with ITSM, monitoring and security stacks.
• Set architecture, coding, testing and release standards, with AI governance aligned to SOC 2 and ISO 27001.
• Work with the Practice and Presales teams to turn each build into a deployable, supportable solution (packaging, sizing, runbooks, demo environments), and hand over to Delivery.
• Hire and lead the AI infrastructure engineering team, and build AI and automation skills across CIS.



What we are looking for
• 18+ years in infrastructure or platform engineering, including 5+ years leading teams that built AI, ML or intelligent-automation solutions.
• At least two AI infrastructure solutions you built from design to production, used by enterprise clients.
• Hands-on production experience with model serving (vLLM, Triton or similar), RAG, agents or MLOps, on cloud and on-prem GPU.
• Strong infrastructure background: cloud, compute, storage, network and observability.
• Experience working with practice, presales and delivery to turn an engineering build into a sellable solution.
• You still write and review code. Technical skills we value vLLM / Triton / TensorRT, NVIDIA GPU stack, Kubernetes for AI workloads (Kueue, Run:ai or similar), vector databases, agent frameworks, evaluation pipelines, Terraform, Ansible, ServiceNow, Python, AWS / Azure / GCP / OCI, SIEM/SOC and identity. Nice to have: Kubernetes (CKA/CKAD), hyperscaler professional or AI specialty certification, NVIDIA certification. Location and working pattern: TRUGlobal office in Bengaluru, with overlap with US hours as needed and periodic US travel.

📌 Head Of AI Infrastructure (Bengaluru)
🏢 TRUGlobal
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: head of ai infrastructure (bengaluru) / bengaluru