NVIDIA is leading the next era of AI computing, bringing Generative AI from the cloud to local devices. The Local AI team develops the software platform that enables developers, enterprises, and creators to build and run AI applications on NVIDIA client platforms, including GeForce RTX PCs, RTX PRO workstations, RTX Spark, DGX Spark, and DGX Station.
The Local AI Automation team is seeking a senior system software engineer passionate about building and maintaining robust infrastructure for deploying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation. If you have a real passion for setting up automation systems in the AI ecosystem to achieve excellence, this could be an excellent prospect for us to work together
What you'll be doing:
Design, implement, and maintain robust infrastructure to efficiently run various AI workloads through different inference backends like Llama.cpp, Ollama, Pytorch, WinML, TRT-RTX, and others.




Scope out the requirements for deploying various AI applications, benchmarks and models in automation, and develop solutions to measure accuracy, functionality and performance.
Develop Infrastructure to download AI models from various sources and efficiently manage a local repository, create an automated synchronization mechanism to keep repository up to date.
Analyze large datasets to derive insights and design visualizations, implement data processing engines to transform raw data into a more usable format for developers to review.
Collaborate with internal Local AI developers to identify and implement features in automation that help them quickly debug/isolate issues.
Design, implement, and maintain robust CI/CD pipelines for automated build and deployment. Collaborate with development teams for seamless integration and deployment.
Understand existing infrastructure and debug issues in current frameworks. Identify performa

📌 Senior System Software Engineer (Pune)
🏢 NVIDIA
📍 Pune