About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems. Our global network of financial crime, compliance, risk, and AI experts helps train and evaluate next-generation AI models through expert AML knowledge, transaction monitoring expertise, and regulatory compliance experience.

Role Overview
We are looking for an AI/ML Engineer to work primarily on managing and evaluating existing AI/ML systems, analyzing AI agents, identifying model failures, and improving overall system performance.
The role requires a solid understanding of LLM/AI fundamentals, model evaluation, AI agent architecture, RAG, model improvement/fine-tuning, and production ML systems.
This is a hands-on role for someone who can not only evaluate AI systems but also understand why models or agents fail and identify practical ways to improve their performance.

Key Responsibilities:
2+ years of experience in AI/ML,



Manage and monitor existing AI/ML and GenAI systems.
Conduct structured LLM and model evaluations using defined benchmarks and evaluation criteria.
Analyze AI/agent outputs and identify accuracy, reasoning, retrieval, tool-use, and behavioral failures.
Analyze AI agent architecture and workflows to identify failure points and performance bottlenecks.
Evaluate and improve RAG pipelines, including retrieval quality and response generation.
Identify opportunities for model improvement, prompt optimization, and fine-tuning.
Analyze evaluation results and translate findings into actionable improvements.
Support testing and validation of new model/agent versions.
Work with production ML systems and help identify reliability, latency, scalability, and performance issues.
Collaborate with engineering and AI teams to implement and validate improvements.
Document evaluation results, failure pat

📌 AI/ML Engineer (Bengaluru)
🏢 Deccan AI Experts
📍 Bengaluru