This role is for one of our clients

Industry: Software Development

Seniority level: Mid-Senior level

Min Experience: 5+ years

Location: Bengaluru

JobType: full time

₹25,00,000 - ₹75,00,000 a year

We are seeking a Software Engineer – Machine Learning Platform to build and scale an AI-native platform that powers intelligent, data-driven applications across complex enterprise workflows. In this role, you will transform unified operational data into real-time intelligence by building the infrastructure that enables context-aware AI agents, retrieval systems, and production-grade machine learning models.

You will own core platform capabilities including the LLM control plane, model gateway, agent runtime, retrieval infrastructure, and ML platform services. Your work will establish the standards for building, evaluating, deploying, and governing both generative AI and traditional machine learning solutions, enabling product teams to deliver AI-powered features safely, reliably, and at scale.

Requirements

Key Responsibilities

LLM Platform & AI Infrastructure





Design and operate an enterprise-grade LLM gateway and control plane featuring intelligent routing, rate limiting, failover, token management, and cost optimization.
Develop unified APIs and SDKs (REST/gRPC) with standardized schemas, structured outputs, caching, and comprehensive observability.
Implement security and privacy controls including content moderation, prompt validation, response filtering, and PII protection.
Enable seamless multi-model and multi-provider LLM integration with automated versioning, canary deployments, and rollback mechanisms.

Agent Platform & Orchestration

Build and maintain the runtime environment for AI agents, including tool registries, permissions, function calling, retrieval, and grounding capabilities.
Design orchestration patterns for sequential, planner-executor, streaming, and long-running workflows.
Integrate human-in-the-loop approval mechanisms and safe execution c

📌 Software Engineer (Bengaluru)
🏢 Weekday`
📍 Bengaluru