Nava is building next-generation AI infrastructure and inference platforms that power enterprise AI at scale. We are looking for a Principal Engineer – GPU Orchestration to lead the design and evolution of our GPU orchestration platform, enabling effective scheduling, resource sharing, and multi-tenant inference workloads.
This role will own the orchestration layer that manages GPU resources for inference and small GPU clusters (2–4 node deployments), ensuring optimal utilization, rapid scaling, workload isolation, and an exceptional customer experience.
What You'll Do
GPU Orchestration & Scheduling
Own the architecture and implementation of GPU scheduling for inference workloads and small GPU clusters (2–4 node deployments).
Design intelligent workload scheduling algorithms that maximize GPU utilization while ensuring fairness and predictable performance.
Manage GPU allocation, quotas, and resource sharing across multiple customers and workloads.
Continuously optimize scheduling policies to improve efficiency and reduce infrastructure costs.
Kubernetes & Platform Engineering
Own the Kubernetes orchestration layer for AI workloads.
Design and maintain GPU-aware scheduling capabilities within Kubernetes.
Improve cluster lifecycle management, workload placement, and infrastructure automation.
Partner with Platform Engineering teams to continuously enhance cluster reliability and scalability.
Multi-Tenancy & Resource Isolation
Design secure multi-tenant GPU environments with strong workload isolation.
Implement resource quotas, admission controls, namespace isolation, and scheduling policies.
Ensure consistent customer experience while maintaining high infrastructure utilization.
Collaborate closely with the Security team on tenancy and access control mechanisms.
Autoscaling & Workload Optimization
Build fast autoscaling capabilities for inference workloads.
Reduce cold-start times through intelligent provisioning and pre-warming strategies.
Optim
📌 Principal Engineer – GPU Orchestration (Bengaluru)
🏢 NAVA
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.