Job Description:

- Design and develop scalable backend services and REST APIs using Python, FastAPI/Flask/Django.

- Build and integrate Generative AI/LLM-based applications, including RAG, AI agents, embeddings, and tool/function calling.

- Work with Azure OpenAI and other LLM providers.

- Use AI frameworks such as LangChain, LlamaIndex, LangGraph, or similar.

- Implement LiteLLM for LLM gateway, routing, fallback, and usage/cost management.

- Implement rate limiting, throttling, caching, retries, and API quotas for scalable services.

- Use Langfuse for LLM observability, tracing, prompt management, token/cost tracking, and evaluation.

- Design and work with PostgreSQL/MySQL, MongoDB, and Redis.

- Deploy and manage applications using Microsoft Azure, Docker, and CI/CD.

- Develop unit/integration tests, troubleshoot production issues, and optimize performance and cost.

- Participate in system design, code reviews,



and technical architecture discussions.

- Required

- 5-7 years of software development experience with strong Python and backend development skills and hands-on experience in Generative AI/LLM applications.

- Robust understanding of REST APIs, microservices, RAG, embeddings, vector databases, prompt engineering, AI agents, rate limiting, and distributed systems.

- Hands-on experience with Azure OpenAI, LiteLLM, and Langfuse is preferred, along with exposure to LangChain/LlamaIndex/LangGraph or similar AI frameworks.

- Experience with Microsoft Azure, Docker, CI/CD, databases, Redis, API security, and cloud-native application development is required.

- Strong problem-solving, communication, ownership, and ability to build production-grade AI solutions are essential.

📌 AI ML Python Developer (Ahmedabad)
🏢 Arrow Electronics India Private
📍 Ahmedabad