We're looking for engineers to help build and productionize AI systems that go well beyond proof-of-concept — real conversational AI, RAG pipelines, and agent architectures running on AWS Bedrock and/or Azure OpenAI, serving live traffic and real users. Whether your strength is on the AI application side (agents, RAG, orchestration) or the platform side (deployment, observability, security), this role sits at the center of turning working demos into production-grade, reliable systems. If you like being close to the frontier of agentic AI and want your work to ship rather than sit in a notebook, this is built for that.
What You'll Do
Design, build, and deploy conversational AI systems, chatbots, and AI agents powered by large language models
Architect and ship production-grade RAG (Retrieval-Augmented Generation) systems — not prototypes, but systems serving live traffic
Build and deploy LLM applications on AWS Bedrock, Azure OpenAI, AgentCore, or equivalent platforms
Develop and orchestrate agent architectures using frameworks such as LangChain, LangGraph, or LlamaIndex
Build and maintain MCP (Model Context Protocol) server integrations to extend agent capabilities
Design and build the production service layer (Lambda, API Gateway, IAM, DynamoDB, OpenSearch, or equivalents)
Establish CI/CD pipelines and manage development, beta, and production environments
Implement observability: tracing, dashboards, per-turn cost and latency metrics, error rates, and audit trails
Implement key security controls — data-leakage protection, session isolation, auth/authz boundaries, secure prompt/response storage
Write clean, maintainable, production-quality Python across the AI application and platform stack
Monitor, evaluate, and iterate on agent, RAG, and platform performance in production
Stay current with quick-moving developments in LLMs, agentic systems, and cloud AI platforms, and bring relevant advances into the project
What You Bring
Proven experience building conversationa
📌 AI/Platform Engineer — AWS Bedrock Agentcore (India)
🏢 Toptal
📍 India