This role is for one of the Weekday's clients
Min Experience: 5+ years
Location: Bengaluru
JobType: full time
We are seeking a Software Engineer – Machine Learning Platform to build and scale an AI-native platform that powers intelligent, data-driven applications across complex enterprise workflows. In this role, you will transform unified operational data into real-time intelligence by building the infrastructure that enables context-aware AI agents, retrieval systems, and production-grade machine learning models.
You will own core platform capabilities including the LLM control plane, model gateway, agent runtime, retrieval infrastructure, and ML platform services. Your work will establish the standards for building, evaluating, deploying, and governing both generative AI and traditional machine learning solutions, enabling product teams to deliver AI-powered features safely, reliably, and at scale.
Key ResponsibilitiesLLM Platform & AI Infrastructure
Design and operate an enterprise-grade LLM gateway and control plane featuring intelligent routing, rate limiting, failover,



token management, and cost optimization.
Develop unified APIs and SDKs (REST/gRPC) with standardized schemas, structured outputs, caching, and comprehensive observability.
Implement security and privacy controls including content moderation, prompt validation, response filtering, and PII protection.
Enable seamless multi-model and multi-provider LLM integration with automated versioning, canary deployments, and rollback mechanisms.
Agent Platform & Orchestration
Build and maintain the runtime environment for AI agents, including tool registries, permissions, function calling, retrieval, and grounding capabilities.
Design orchestration patterns for sequential, planner-executor, streaming, and long-running workflows.
Integrate human-in-the-loop approval mechanisms and safe execution controls before automated actions interact with production systems.
Monitor agent performance, reliability, and ope

📌 Software Engineer (Bengaluru)
🏢 Weekday AI
📍 Bengaluru