Overview
We are the Azure AI Inferencing team, part of the CoreAI Foundry business that builds and runs the model-serving platform including, but not limited to, large OpenAI generative models.
This team is at the forefront of delivering this innovation with massive scale powering every Azure OpenAI customer and scenario in the industry, both 3P and 1P customer like Bing and Office and solve exciting problems on the intersection of AI and Cloud. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.
Role Summary
Microsoft is leading the AI strategy with an ambitious mission to democratize AI, make it an essential ingredient for delivering breakthrough customer experiences and to ensure the advantages of AI reach every person and organization on the planet, safely and responsibly.
We are looking for a Software Engineer, who is passionate about designing and building highly reliable, available platform to support model inferencing at the scale of billions of requests per day.



You will be working on high throughput/low latency scenarios and drive performance optimization capabilities.
Microsoft is leading the AI strategy with an ambitious mission to democratize AI, make it an essential ingredient for delivering breakthrough customer experiences and to ensure the benefits of AI reach every person and organization on the planet, safely and responsibly. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.

Responsibilities
Responsibilities :
Lead architecture and design of complex, distributed systems; make key technical decisions and mentor engineers on design tradeoffs and best practices.
Own solution quality end‑to‑end, including test strategy, security testing, reliability, and operational readiness.
Drive cross‑team collaboration, identifying depend

📌 Principal Software Engineer (Bengaluru)
🏢 Microsoft
📍 Bengaluru