We are seeking a skilled Python + AI ML Engineer ,Bangalore having 5+ yrs of experience.

About Us

CodeVyasa is a mid-sized product engineering company that works with top-tier product and solutions organizations such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are a team of 550+ engineers, driving innovation across Product & Data Engineering, focusing on Agentic AI, RPA, Full Stack, and GenAI-based solutions.

Must-Have Skills

- Strong hands-on experience with Python
- Strong production experience with Flask and/or FastAPI
- Strong backend development experience with REST APIs, microservices and scalable architectures
- Hands-on experience building AI/LLM workflows and applications
- Experience with LLM integration, prompt engineering and model/API orchestration
- Valuable understanding of RAG, embeddings, vector databases and retrieval workflows
- Experience integrating LLMs with backend applications and enterprise systems
- Strong understanding of API design, authentication, error handling and performance optimization
- Experience with databases such as PostgreSQL, MySQL or MongoDB
- Good understanding of asynchronous processing, queues and distributed systems

AI/LLM Responsibilities

- Design and develop LLM-powered backend applications and workflows
- Integrate LLM APIs and AI services into production systems
- Build and optimize RAG and retrieval-based workflows
- Develop prompt chains, tool/function calling and AI-driven automation
- Work with vector databases and embedding-based search




- Evaluate and improve LLM response quality, latency and reliability
- Implement appropriate guardrails, monitoring and error handling for AI workflows

Backend Responsibilities

- Build scalable and maintainable backend services using Python + Flask/FastAPI
- Design and develop REST APIs and microservices
- Optimize application performance, database queries and API response times
- Develop integrations with internal and external systems
- Write clean, testable and production-ready code
- Collaborate with AI/ML, frontend and product teams to deliver end-to-end solutions

Good to Have

- Experience with LangChain, LangGraph, LlamaIndex or similar LLM frameworks
- Experience with OpenAI, Azure OpenAI, Anthropic or other LLM APIs
- Exposure to AWS/Azure/GCP
- Experience with Docker and Kubernetes
- Knowledge of Kafka, RabbitMQ or other messaging systems
- Experience with AI agents, tool calling and multi-agent workflows
- Familiarity with LLM evaluation and observability tools

Why Join CodeVyasa?

- Work on innovative, high-impact projects with leading global clients.
- Exposure to modern technologies, scalable systems, and cloud-native architectures.
- Continuous learning and upskilling opportunities through internal and external programs.
- Supportive and collaborative work culture with flexible policies.
- Competitive salary and comprehensive benefits package.
- Free healthcare coverage for employees and dependents.

📌 Python +AI ML Engineer (Bengaluru)
🏢 MNC
📍 Bengaluru