Job Requisition ID

JR2021898

Job Category

Engineering

Time Type

Full time

NVIDIA has continuously reinvented itself for over two decades. The invention of the GPU in 1999 propelled the growth of PC gaming, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning has ignited modern AI, positioning NVIDIA as a leading AI computing company. There is a growing focus on delivering AI models locally, closer to the source of data. This reduces latency, improves real-time processing, and addresses privacy concerns by minimizing data transfer to centralized servers. As technology advances, client-side AI (local execution) will play a key role in crafting digital experiences.

The Local AI team is seeking a System Software Manager to lead development of an efficient on-device AI software stack. The software stack will support RTX, RTX Pro, and DGX-class systems. This role focuses on high-performance local inference, agentic workloads, low latency, effective memory use, scalable infrastructure,



practical deployment on resource-constrained platforms, and delivering a streamlined out-of-box experience for developers and end users.

What You'll Be Doing

Lead and grow a team building the on-device AI inference platform for RTX, RTX Pro, and DGX GPUs, with accountability for execution, technical direction, delivery quality, and roadmap alignment.
Drive cross-functional alignment with NVIDIA’s software, research, architecture, and product teams, along with industry partners and open-source communities, to build strategy and strengthen the AI ecosystem across RTX and DGX platforms.
Provide technical leadership for the architecture and evolution of modern inference runtimes and execution stacks across frameworks such as Llama.cpp, vLLM, PyTorch, WinML, DXCGC, and TensorRT-RTX, spanning workloads including LLMs, vision-language models, TTS, ASR, and diffusion models.
Mentor engineers, develop technical leaders, and foster a high

📌 Manager, System Software Engineering (India)
🏢 nvidia ai
📍 India