About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a robust founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems.

About the Role
We are seeking a Sampling Analyst (Freelancer) to support advanced AI evaluation initiatives focused on quality assurance, audit sampling, reviewer performance analysis, error classification, and continuous quality improvement.
In this role, you will evaluate AI-generated outputs and human review workflows by designing sampling strategies, identifying quality trends, analyzing reviewer errors, and recommending corrective actions. Your expertise will help improve AI evaluation systems by ensuring consistent quality, accurate reporting, and scalable quality assurance processes.
This position is ideal for professionals with experience in quality assurance, audit operations, AI data operations, process excellence, analytics, or quality management.

Responsibilities




Create deliverables addressing real-world quality assurance and audit sampling scenarios.
Annotate and evaluate AI-generated quality reports, audit findings, reviewer performance metrics, and quality dashboards.
Assess AI outputs for accuracy, consistency, completeness, and compliance with evaluation guidelines.
Design and evaluate audit sampling methodologies to ensure representative and statistically sound quality reviews.
Develop and maintain error taxonomies by categorizing reviewer errors, annotation issues, policy violations, and quality defects.
Perform root cause analysis (RCA) to identify recurring quality issues, workflow bottlenecks, reviewer inconsistencies, and process gaps.
Track corrective and preventive actions (CAPA), monitor implementation progress, and evaluate the effectiveness of quality improvement initiatives.
Prepare and review accuracy reports, quality dashboards, reviewer scorecards, and trend analyses to sup

📌 Sampling Analyst (India)
🏢 Deccan AI Experts
📍 India