Description
This role is for one of the Weekday's clients

Min Experience: 5+ years
Location: Bengaluru
JobType: full-time

We are seeking a Software Engineer – Machine Learning Platform to build and scale an AI-native platform that powers intelligent, data-driven applications across complex enterprise workflows. In this role, you will transform unified operational data into real-time intelligence by building the infrastructure that enables context-aware AI agents, retrieval systems, and production-grade machine learning models.
You will own core platform capabilities including the LLM control plane, model gateway, agent runtime, retrieval infrastructure, and ML platform services. Your work will establish the standards for building, evaluating, deploying, and governing both generative AI and traditional machine learning solutions, enabling product teams to deliver AI-powered features safely, reliably, and at scale.

Requirements
Key Responsibilities
LLM Platform & AI Infrastructure




- Design and operate an enterprise-grade LLM gateway and control plane featuring intelligent routing, rate limiting, failover, token management, and cost optimization.
- Develop unified APIs and SDKs (REST/gRPC) with standardized schemas, structured outputs, caching, and comprehensive observability.
- Implement security and privacy controls including content moderation, prompt validation, response filtering, and PII protection.
- Enable seamless multi-model and multi-provider LLM integration with automated versioning, canary deployments, and rollback mechanisms.

Agent Platform & Orchestration
- Build and maintain the runtime workplace for AI agents, including tool registries, permissions, function calling, retrieval, and grounding capabilities.
- Design orchestration patterns for sequential, planner-executor, streaming, and long-running workflows.
- Integrate human-in-the-loop approval mechanisms and safe execution controls before automated actions interact with production systems.
- M

📌 Software Engineer (Bengaluru)
🏢 Weekday AI
📍 Bengaluru