This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead DevOps Engineer (AI & GPU) based in India (Bangalore, Remote).

As a Lead DevOps Engineer (AI & GPU), you will lead the design, deployment, and operation of the infrastructure that powers production-grade AI services and high-performance inference workloads. You will build robust CI/CD pipelines, optimize GPU-based model serving, and establish reliable delivery processes across cloud, on-premises, edge, and air-gapped environments. Your work will ensure AI applications are deployed securely, operate efficiently, and remain observable throughout their lifecycle. You will oversee platform observability, resource utilization, cost attribution, and governance to deliver scalable, transparent, and economically sustainable AI operations. Collaborating with platform, security, data, and engineering teams, you will integrate automation, continuous verification, and policy enforcement into every stage of delivery.



This role offers the prospect to shape advanced AI infrastructure while solving complex challenges involving performance, security, reliability, and multi-tenant operations.

n

Accountabilities:

• Lead the design, implementation, and operation of CI/CD and continuous verification (CV) pipelines for AI services, agents, and runtime components, covering automated builds, testing, releases, validation, and rollback.

• Implement and manage GitOps-based deployment workflows using tools such as Argo CD, Helm, GitHub Actions, GitLab CI, or equivalent technologies to ensure consistent and repeatable delivery.

• Operate and optimize production-scale AI inference and model-serving infrastructure using frameworks such as Ray Serve, vLLM, NVIDIA Triton, or NVIDIA NIM across GPU-enabled environments.

• Manage AI asset governance and discovery, including artifact and container registries, model metadata, experiment tracking, upstream mod

📌 Lead DevOps Engineer (India)
🏢 Jobgether
📍 India