Overview
We are hiring a Software Engineer II to build recent AI platform capabilities for Windows Server across on-premises and hybrid customer deployments. You will be at the forefront of AI inference in a novel environment, and your work will infuse cutting edge AI concepts into existing Server platforms and workflows.
AI technologies evolved in the cloud, and you will translate those cloud-connected ideas to air-gapped, on-premises and hybrid environments. You will work at the intersection of AI models, agents, identity, and management surfaces on our most hardened OS platform. Experience or demonstrated interest in operating system fundamentals is a plus; experience with existing AI inference toolchains is valued.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity,



and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities
- Design and implement how we track usage, policy and efficiency for artificial intelligence capabilities.
- Build observability pipelines through telemetry insights, diagnostics, and health signals needed to measure how this on-prem infrastructure is performing.
- Define and develop the management layer for AI inference toolchains from model lifecycles and catalogs to language and protocol gateways.
- Design and implement validation plans to assess the quality of this infrastructure and evaluate the end to end workflows and life cycle experiences of such a solution.
- Coordinate with security and compliance teams to ensure this toolchain meets or exceeds platform release requirements.

Qualifications
Required/Minimum Qualifications:
- Bachelor's Degree in Computer Science, Engineering, or a related technical field, and 5+ years of software engineering experience.

📌 Software Engineer II (Bengaluru)
🏢 Microsoft
📍 Bengaluru