We are seeking an experienced Python Backend Developer to design, build, and deploy scalable AI-powered applications using Retrieval-Augmented Generation, large language models, and agentic AI frameworks. The role will focus on delivering a production-grade RAG system and AI chatbot that can securely integrate with enterprise data, APIs, databases, and cloud services.

Task and deliverables:
- Design the end-to-end architecture for a scalable RAG system and AI chatbot.
- Develop Python backend services, REST APIs, and microservices using FastAPI or similar frameworks.
- Build document ingestion, chunking, embedding, indexing, retrieval, and reranking pipelines.
- Implement vector search solutions using Azure AI Search or comparable vector databases.
- Design autonomous AI agents capable of planning, reasoning, tool usage, and decision-making.
- Develop multi-step AI workflows using LangGraph, LangChain, CrewAI, AutoGen, or similar orchestration frameworks.
- Integrate commercial and open-source LLMs, including Azure OpenAI, OpenAI, Anthropic Claude, Gemini, and comparable models.




- Implement conversation memory, session management, context management, and agent collaboration patterns.
- Connect AI workflows with APIs, databases, enterprise systems, and external tools.
- Develop asynchronous, high-performance services capable of handling concurrent AI workloads.
- Implement prompt management, structured outputs, guardrails, fallback logic, and model evaluation processes.
- Establish logging, monitoring, tracing, observability, security, and error-handling standards.
- Containerize and deploy AI services using Docker, Kubernetes, Azure, or AWS.
- Translate business requirements into technical designs, delivery milestones, and production-ready AI solutions.
- Collaborate with the wider team while independently owning architecture and implementation decisions.

Required experience:
- 8 or more years of qualified Python backend development experience.
- Strong experie

📌 Python Backend Developer with RAG (India)
🏢 Toptal
📍 India