We are looking for an experienced GPU DevOps / Infrastructure Setup Engineer to build, configure, deploy, and maintain GPU-enabled infrastructure for AI/ML and High-Performance Computing (HPC) workloads.
The ideal candidate will have hands-on experience with GPU server setup, on-premises AI infrastructure, Linux administration, NVIDIA GPU drivers, CUDA, containerization, infrastructure automation, and GPU workload deployment.
Experience with NVIDIA Base Command Manager (BCM), GPU cluster bring-up, InfiniBand networking, and LLM application deployment will be highly preferred. Candidates with experience across different GPU hardware vendors and cloud, on-premises, or hybrid environments are welcome.
Key Responsibilities
• Set up, configure, and maintain GPU-enabled servers, compute nodes, and AI infrastructure.
• Build and deploy on-premises AI infrastructure and GPU compute clusters.
• Perform end-to-end GPU cluster bring-up, including provisioning, configuration, validation, and testing.
• Configure and manage NVIDIA Base Command Manager (BCM) for cluster deployment and management,



where applicable.
• Install and configure operating systems, GPU drivers, CUDA Toolkit, libraries, and supporting software.
• Deploy and maintain GPU workloads on bare-metal servers, cloud platforms, and hybrid environments.
• Configure GPU-enabled Docker containers and Kubernetes workloads.
• Deploy and manage LLM applications using frameworks such as vLLM, Ollama, Hugging Face Text Generation Inference (TGI), or NVIDIA Triton.
• Configure and troubleshoot GPU hardware, driver compatibility, CUDA initialization, memory utilization, and workload execution issues.
• Support InfiniBand networking and high-speed interconnects for multi-GPU or multi-node environments.
• Automate infrastructure provisioning, configuration management, and deployment using appropriate scripting and automation tools.
• Develop and maintain CI/CD pipelines for infrastructure and application deployments.
• Monitor

📌 GPU DevOps (Hyderabad)
🏢 Cinergy Technology
📍 Hyderabad