Job Description

About Nava

Nava is building next-generation AI infrastructure and inference platforms that power enterprise AI at scale. We are looking for a Principal Engineer – GPU Orchestration to lead the design and evolution of our GPU orchestration platform, enabling efficient scheduling, resource sharing, and multi-tenant inference workloads.

This role will own the orchestration layer that manages GPU resources for inference and small GPU clusters (2–4 node deployments), ensuring optimal utilization, rapid scaling, workload isolation, and an exceptional customer experience.

What You'll Do

GPU Orchestration & Scheduling
Own the architecture and implementation of GPU scheduling for inference workloads and small GPU clusters (2–4 node deployments).
Design intelligent workload scheduling algorithms that maximize GPU utilization while ensuring fairness and predictable performance.
Manage GPU allocation, quotas, and resource sharing across multiple customers and workloads.




Continuously optimize scheduling policies to improve efficiency and reduce infrastructure costs.

Kubernetes & Platform Engineering
Own the Kubernetes orchestration layer for AI workloads.
Design and maintain GPU-aware scheduling capabilities within Kubernetes.
Improve cluster lifecycle management, workload placement, and infrastructure automation.
Partner with Platform Engineering teams to continuously enhance cluster reliability and scalability.

Multi-Tenancy & Resource Isolation
Design secure multi-tenant GPU settings with solid workload isolation.
Implement resource quotas, admission controls, namespace isolation, and scheduling policies.
Ensure consistent customer experience while maintaining high infrastructure utilization.
Collaborate closely with the Security team on tenancy and access control mechanisms.

Autoscaling & Workload Optimization
Build rapid autoscaling capabilities for inference workloads.
Reduce cold-start times through intelligent provi

📌 Principal Engineer Gpu Orchestration Bengaluru
🏢 NAVA
📍 Bengaluru