About Us

Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems. Our global network of financial crime, compliance, and AI experts helps train and evaluate next-generation AI agents through expert judgment, regulatory expertise, and real-world financial crime investigation experience.

About the Role

We are seeking an Agentic AI Evaluation Specialist – Financial Crime (Freelancer) to support advanced AI evaluation initiatives focused on AI agents performing complex financial crime investigations, AML/KYC workflows, sanctions screening, fraud detection, transaction monitoring, compliance reasoning, and regulatory decision-making.

In this role, you will evaluate how AI agents perform multi-step financial crime investigations, analyze evidence, apply regulatory requirements, justify decisions, and generate investigation reports. Your expertise will help improve AI systems designed to automate financial crime operations while maintaining regulatory accuracy and investigative quality.

This position is ideal for professionals with experience in Financial Crime Compliance, Anti-Money Laundering (AML), Know Your Customer (KYC), Fraud Risk, Sanctions Compliance, Financial Crime Investigations, or Regulatory Compliance.

Responsibilities

- Review AI-generated customer risk assessments, transaction investigations, sanctions reviews, adverse media analysis, PEP screening, and case management documentation.
- Verify AI-generated recommendations against applicable regulations, internal compliance policies, and industry best practices.
- Identify reasoning failures, missed red flags, incorrect risk classifications, hallucinations, incomplete investigations, and compliance gaps.
- Build structured evaluation rubrics for agent performance across multiple investigation stages.




- Provide detailed feedback to improve AI agent reasoning, planning, and financial crime decision-making.
- Review peer-created evaluation tasks to ensure consistency and quality.

Requirements

- Bachelor's degree in Finance, Accounting, Economics, Banking, Business Administration, Law, Criminal Justice, Risk Management, or a related field.
- Master's degree or relevant skilled qualification is preferred.
- 5+ years of hands-on experience in Financial Crime Compliance, AML, KYC, Fraud Investigations, Sanctions Compliance, Regulatory Compliance, Banking Operations, or Financial Crime Risk Management.
- Conducting complex AML and fraud investigations.
- Reviewing transaction monitoring alerts and suspicious activity.
- Preparing Suspicious Activity Reports (SARs).
- Performing customer risk assessments and enhanced due diligence.
- Reviewing AI-generated financial crime investigations and compliance documentation.

Preferred Qualifications

- Experience evaluating AI systems, LLMs, AI agents, or decision-support tools used in compliance and financial crime operations.
- Experience with AI benchmarking, AI red teaming, RLHF (Reinforcement Learning from Human Feedback), prompt engineering, or AI model evaluation.
- Experience building evaluation datasets, quality frameworks, or compliance testing methodologies.
- Experience working with global banks, fintech companies, payment providers, consulting firms, or RegTech organizations.
- Familiarity with Generative AI, Retrieval-Augmented Generation (RAG), agentic workflows, MCP (Model Context Protocol), or enterprise AI governance is highly desirable.

Why Join Us

- Competitive hourly pay: ₹2,000/hour
- Fully remote with flexible working hours.
- Opportunity to work on cutting-edge Agentic AI and Generative AI evaluation projects.
- Collaborate with AI researchers, compliance professionals, and financial crime experts worldwide.
- Help improve AI agents that support banking, fintech, regulatory technology, and enterprise compliance operations.
- Flexible project-based engagements with global teams.

📌 Agentic AI Evaluation Specialist Financial Crime (Freelancer) (Pune)
🏢 Deccan AI Experts
📍 Pune