Neysa Mumbai Metropolitan Region

Senior AI Compute Engineer

Deploy, Optimize & Operate Next-Generation AI Infrastructure at Scale

About The Role

We are building next-generation AI infrastructure powering LLM training, inference clusters, and HPC workloads. As a Senior AI Compute Engineer, you will design, deploy, and operate GPU clusters based on NVIDIA and AMD GPU infrastructure—managing everything from hardware configuration and Linux optimization to Kubernetes orchestration and customer success. You will work with team end-to-end: from architecture planning and production rollout through optimization and technical support.

This is hands-on infrastructure engineering at neo cloud.

What You Will Be Doing:

- Deploy and manage AI GPU clusters (NVIDIA and AMD) for enterprise and cloud customers—end-to-end ownership from planning to production acceptance
- Manage advanced Linux systems (RHEL, Ubuntu, Rocky) with expertise in kernel tuning, driver optimization, and system performance at scale
- Build and optimize GPU infrastructure: configure CUDA, NVIDIA drivers, GPU Operator, GPUDirect RDMA, NVLink, and NVSwitch
- Deploy and operate Kubernetes clusters with GPU support using Helm, Docker, and Containerd for AI workload orchestration
- Configure and optimize Slurm, MPI, and parallel file systems for distributed AI training and HPC workloads
- Perform root cause analysis on production incidents and proactively reduce cluster issues through validation and monitoring

What we need to see:Core Compute (8+ years)
- 8+ years of hands-on Linux systems administration and data center infrastructure deployment
- 3+ years of HPC infrastructure experience with job schedulers (Slurm/PBS) and parallel computing
- Expertise in Linux administration (RHEL, Ubuntu, Rocky)—kernel tuning, driver management, PCIe troubleshooting, performance optimization
- Proficiency with GPU infrastructure (NVIDIA GPUs, CUDA, GPUDirect RDMA, NVLink, DCGM monitoring and troubleshooting)
- Experience with Kubernetes and container orchestration (Helm, Docker, Containerd, GPU Operator, CSI drivers)

Automation & Infrastructure-as-Code
- 3+ years of infrastructure automation using Python, Bash, Ansible, Terraform, or SaltStack
- Ability to develop provisioning workflows, CI/CD pipelines, and version control with Git
- Strong scripting skills to automate deployment, validation, and operational tasks at scale

Ways To Stand Out From The Rest:

- NVIDIA certifications (AI Infrastructure, AI Operations, Certified Associate/Professional)
- Kubernetes certifications (CKA, CKS) or Red Hat Certified Engineer (RHCE)
- Experience with AI Factory deployments, LLM training clusters, or GPU cloud platforms
- Background with NVIDIA DGX SuperPOD, HGX clusters, or NVIDIA Spectrum-X networking
- Experience with monitoring stacks (Prometheus, Grafana, DCGM, ELK, Loki) and observability in distributed systems
- Hands-on experience with advanced storage systems (Ceph, GPFS, Weka, VAST) or bare-metal provisioning (MAAS, Foreman)

Minimum Qualifications

- Bachelor's degree in Computer Science, Electrical Engineering, Electronics, Information Technology, or equivalent professional experience
- 8+ years of Linux systems administration and data center deployment
- 4+ years of consulting or customer-success engineering roles

Soft Skills

- Solid problem-solving and debugging abilities across hardware, kernel, and application layers
- Ownership mindset with accountability for deployment quality and customer success
- Cross-functional collaboration with other teams
- Proactive approach to continuous learning and staying current with AI infrastructure trends
- Strong documentation and presentation skills, able to defend design decisions amongst peers.
- Seniority level Not Applicable
- Employment type Full-time
- Job function Advertising, Engineering, and Information Technology
- Industries Software Development

Senior AI Compute Engineer Deploy, Optimize & Operate Next-Generation AI Infrastructure at Scale

Soft Skills





- Strong problem-solving and debugging abilities across hardware, kernel, and application layers
- Ownership mindset with accountability for deployment quality and customer success
- Cross-functional collaboration with other teams
- Proactive approach to continuous learning and staying current with AI infrastructure trends
- Strong documentation and presentation skills, able to defend design decisions amongst peers.

Referrals increase your chances of interviewing at Neysa by 2x

See who you know

- Senior AI Compute Engineer

Senior AI Compute Engineer

Neysa

Mumbai Metropolitan Region 17 hours ago
- Senior Solutions Architect, GPU Cloud GenAI – Infrastructure

Senior Solutions Architect, GPU Cloud GenAI – Infrastructure

NVIDIA

Mumbai, Maharashtra, India 2 weeks ago
- GPU Infrastructure Engineer / HPC Engineer

GPU Infrastructure Engineer / HPC Engineer Larsen & Toubro

Mumbai Metropolitan Region 17 hours ago

- AI Infrastructure Architect

AI Infrastructure Architect

Accenture in India

Mumbai Metropolitan Region 1 week ago
- AI Infrastructure Architect

AI Infrastructure Architect

Accenture in India

Navi Mumbai, Maharashtra, India 1 week ago
- Lead Engineer (HPC, GPU, CUDA)

Lead Engineer (HPC, GPU, CUDA)

AIRA Matrix

Thane, Maharashtra, India 3 weeks ago
- HPC L3 AI

HPC L3 AI Yotta Data Services Private Limited

Mumbai Metropolitan Region 3 weeks ago

- Technical Lead — Agentic AI & MVP

Technical Lead — Agentic AI & MVP

BNP Paribas

Mumbai Metropolitan Region 2 weeks ago
- Senior Solution Architect, Cloud Infrastructure-DevOps

Senior Solution Architect, Cloud Infrastructure-DevOps

NVIDIA

Mumbai, Maharashtra, India 5 days ago
- Sr ML & AI Engineer

Sr ML & AI Engineer

HERE Technologies

Mumbai Metropolitan Region 4 days ago
- HPC Engineer

HPC Engineer Yotta Data Services Private Limited

Mumbai Metropolitan Region 3 weeks ago

- Founding AI/ML Engineer

Founding AI/ML Engineer

Cutshort

Mumbai Metropolitan Region ₹10,000,000 - ₹15,000,000 15 hours ago
- Generative AI Forward Deployed Engineer, Google Cloud

Generative AI Forward Deployed Engineer, Google Cloud

Google

Mumbai, Maharashtra, India 4 days ago
- AI Engineer : Mumbai

AI Engineer : Mumbai

CashFlo

Mumbai Metropolitan Region 3 months ago
- AI Agent Engineer

AI Agent Engineer

Lexsi Labs

Mumbai Metropolitan Region 1 month ago
- Technical Support Engineer (Inference) - India Weekends

Technical Support Engineer (Inference) - India Weekends

Together AI

Mumbai Metropolitan Region 2 days ago
- AI / ML Platform Engineer

AI / ML Platform Engineer

BNP Paribas

Mumbai, Maharashtra, India 3 weeks ago
- Senior Software Engineer - Infrastructure

Senior Software Engineer - Infrastructure

Lexsi Labs

Mumbai Metropolitan Region 1 month ago
- Principal Engineer

Principal Engineer

Truemeds

Mumbai, Maharashtra, India 21 hours ago
- Founding Engineer in Bangalore, Mumbai (Hybrid)

Founding Engineer in Bangalore, Mumbai (Hybrid)

Nova Labs

Mumbai Metropolitan Region 6 days ago
- Azure Infrastructure And AI

Azure Infrastructure And AI Promaynov Advisory Services Pvt. Ltd

Mumbai Metropolitan Region 2 months ago

- Senior AI production Engineer

Senior AI production Engineer L&T; Finance

Mumbai, Maharashtra, India 1 week ago

- Staff Software Engineer (Python)

Staff Software Engineer (Python)

Sia

Mumbai Metropolitan Region 3 weeks ago
- Sr.

Machine Learning

Engineer (MLOps)

Sr.

Machine Learning

Engineer (MLOps)

General Mills

Mumbai Metropolitan Region 1 week ago
- MLOps

MLOps

Qloron Pvt Ltd

Mumbai Metropolitan Region 1 month ago
- Senior AI Engineer

Senior AI Engineer





Pepper

Mumbai, Maharashtra, India 3 weeks ago
- ML Engineer

ML Engineer

Priceline

Mumbai, Maharashtra, India 2 weeks ago
- Senior Machine Learning Engineer (Library)

Senior Machine Learning Engineer (Library)

Loopio

Mumbai Metropolitan Region 4 months ago
- Lead AI Engineer

Lead AI Engineer

Kissht

Mumbai, Maharashtra, India 3 weeks ago
- Lead Machine Learning Engineer (MLops)

Lead Machine Learning Engineer (MLops)

General Mills

Mumbai Metropolitan Region 1 week ago
- Senior AI Backend Engineer

Senior AI Backend Engineer

Version 1

Mumbai Metropolitan Region 1 day ago
- Senior AI Engineer - India

Senior AI Engineer - India Acrotrend - A NowVertical Company

Navi Mumbai, Maharashtra, India 1 month ago

- Software Engineer, Data Infrastructure & Acquisition - Mumbai, India

Software Engineer, Data Infrastructure & Acquisition - Mumbai, India

Speechify

Mumbai, Maharashtra, India 4 weeks ago
- Specialist Solutions Architect - AI/ML

Specialist Solutions Architect - AI/ML

Databricks

Mumbai Metropolitan Region 2 weeks ago
- Senior Solution Architect, Cloud Infrastructure - DevOps

Senior Solution Architect, Cloud Infrastructure - DevOps

NVIDIA

Mumbai, Maharashtra, India 6 days ago
- LLM Operations Engineer

LLM Operations Engineer

Accenture in India

Navi Mumbai, Maharashtra, India 1 week ago
- Sr Software Engineer Developer

Sr Software Engineer Developer

Lexsi Labs

Mumbai Metropolitan Region 1 day ago
- Software Test Lead jobs

2,480 open jobs
- System Architect jobs

4,468 open jobs
- Associate Engineer jobs

5,311 open jobs
- Solutions Engineer jobs

8,360 open jobs
- Nurse Practitioner jobs

223 open jobs
- Finance Specialist jobs

6,071 open jobs
- Internal Auditor jobs

2,281 open jobs
- Windows Administrator jobs

1,412 open jobs
- Head of Product Marketing jobs

1,393 open jobs
- Engineer jobs

71,158 open jobs
- Scientist jobs

2,584 open jobs
- Vice President of Engineering jobs

443 open jobs
- Enterprise Sales Manager jobs

2,715 open jobs
- Technology Officer jobs

49,304 open jobs
- Developer jobs

73,513 open jobs
- Director of Engineering jobs

811 open jobs
- Linux System Administrator jobs

1,311 open jobs
- Release Manager jobs

5,638 open jobs
- Channel Sales Manager jobs

3,205 open jobs
- PHP Developer jobs

6,106 open jobs
- Engineering Manager jobs

11,136 open jobs
- Senior Technical Consultant jobs

9,814 open jobs
- Application Developer jobs

21,665 open jobs
- Unix Linux System Administrator jobs

251 open jobs
- Solutions Architect jobs

14,142 open jobs
- Software Test Lead jobs
- JioSaavn jobs
- System Architect jobs
- Associate Engineer jobs
- Amdocs jobs
- CRED jobs
- Solutions Engineer jobs
- Coupa jobs
- Electronic Arts (EA) jobs
- Haptik jobs
- IDfy jobs
- ADP jobs
- Nurse Practitioner jobs
- Finance Specialist jobs
- NowFloats jobs
- Internal Auditor jobs
- Samsung Electronics jobs
- LetsTransport jobs
- Practo jobs
- Healthify jobs
- Oracle jobs
- Windows Administrator jobs
- Head of Product Marketing jobs
- PayPal jobs
- Uniphore jobs
- InsuranceDekho jobs
- Engineer jobs
- Scientist jobs
- Vice President of Engineering jobs
- mPokket jobs
- Enterprise Sales Manager jobs
- Technology Officer jobs
- Developer jobs
- Director of Engineering jobs
- Tiger Analytics jobs
- Linux System Administrator jobs
- Fractal jobs
- MediBuddy jobs
- Instamojo jobs
- Release Manager jobs
- Channel Sales Manager jobs
- PHP Developer jobs
- Uber jobs
- RentoMojo jobs
- Engineering Manager jobs
- Senior Technical Consultant jobs
- Application Developer jobs
- ShareChat jobs
- Unix Linux System Administrator jobs
- Solutions Architect jobs
- Capillary Technologies jobs
- Full Stack Engineer jobs
- Senior Software Engineer jobs
- Network Operations Center Engineer jobs
- Pocket FM jobs
- Ather Energy jobs
- Head of Marketing jobs
- System Integrator jobs
- FIS jobs
- Infosys jobs

📌 Senior AI Compute Engineer (Mumbai)
🏢 Nexus Venture Partners
📍 Mumbai