Home/Jobs/ML - Principal Software Engineer

ML - Principal Software Engineer

Microsoft

Hyderabad

6+ years

1 day ago

$91.6K–113.3K/yr

Full time

Hybrid

Skills Required LLM

Machine Learning

ML inference pipelines

ML systems edge computing

Windows

Windows AI Platform

ML compiler design hardware-aware optimizations scalable infrastructure heterogeneous platforms

C

C++

C#

Java

Description Principal Software Engineer role on the Windows AI Platform & Tools Team, focused on shaping AI experiences on Windows and Devices. The team builds scalable, edge-focused ML solutions and works across Microsoft and hardware ecosystem partners.

Company: Microsoft

Role: ML - Principal Software Engineer

Location: India, Telangana, Hyderabad

Experience

- 6+ years technical engineering experience with coding
- Proven ability to define long-term ML infrastructure strategy
- Ability to drive cross-org alignment across engineering, product, and research
- Hands-on experience building robust ML systems
- Experience with high reliability, low latency, and seamless platform integration
- Ability to meet Microsoft, customer, and/or government security screening requirements

Qualification

- Bachelor's Degree in Computer Science or related technical field
- Master's Degree in Computer Science or related technical field

Responsibilities

- Partner with stakeholders to determine user requirements for complex scenarios
- Provide technical leadership for dependency identification and design documents
- Lead and mentor others to produce extensible and maintainable code
- Lead multiple product project plans, release plans, and work items with stakeholders
- Serve as Designated Responsible Individual and work on call to monitor systems for degradation, downtime, or interruptions
- Improve availability, reliability, efficiency, observability, and performance of products
- Drive consistency in monitoring and operations at scale
- Share knowledge with other engineers




- Collaborate across Microsoft and with hardware ecosystem partners
- Architect and build high-performance software that powers AI capabilities across Windows and Devices
- Enable developers to deploy machine learning models at scale
- Optimize edge execution
- Guide system-level decisions for scheduling, memory orchestration, power-aware execution, and secure execution

Additional Responsibilities

- Work in an individual contributor role
- Full-time employment
- Partial remote work options
- 3 days per week in-office
- Travel less than 25%
- Pass Microsoft Cloud background check upon hire or transfer and every two years thereafter

Nice To Have

- 12+ years technical engineering experience with coding
- 10+ years technical engineering experience with coding
- Experience architecting ML inference pipelines for LLMs
- Experience building local model integrations in system or app level components
- Mastery in ML compiler design
- Hardware-aware optimizations
- Scalable infrastructure across heterogeneous platforms

More Skills AI, JavaScript, Python, software engineering, scheduling, memory orchestration, power-aware execution, secure execution, system-level design, observability, performance, reliability, efficiency, monitoring, operations at scale

Prepare for this role

Recommended resources to build the skills for this position. Sponsored.

Top 50 LLM System Design Interview Questions

Zenaique

Curated LLM system design questions from Zenaique.

Top 20 LLM System Design Questions (Quick)

Zenaique A focused LLM system design interview question set.

Top 25 xAI Interview Questions

Zenaique An xAI-focused interview question set from Zenaique.

More LLM jobs

Trainee Software Engineer – AI

Techvantage.ai

Thiruvananthapuram

Today

AI Technical Lead

Hitachi Solutions India Pvt Ltd

Chennai

Today

Senior Analyst – AI/Technology Development

Desri

Hyderabad

Today

Software Engineer (AI-Powered Advertising Agents - AgenticOS)

PubMatic

Pune

Today

Senior Software Engineer, AI Compilers

NXP Semiconductors

Hyderabad

Today

Principal AI Engineer

ABC Fitness

Hyderabad

Today

📌 ML - Principal Software Engineer (Hyderabad)
🏢 Top Gen AI Jobs
📍 Hyderabad