About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a robust founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems.

About the Role
We are seeking a Data Quality Reviewer (Freelancer) to support advanced AI evaluation initiatives focused on data quality assurance, annotation review, dataset validation, AI benchmarking, and quality calibration.
In this role, you will review annotated datasets, evaluate AI-generated outputs, validate labeling accuracy, and ensure high-quality training and evaluation data for large language models (LLMs), computer vision, speech AI, and multimodal AI systems. Your expertise will help improve the reliability, consistency, and performance of next-generation AI models.
This position is ideal for professionals with experience in data quality assurance, annotation review, AI evaluation, quality auditing, content review, data operations, or analytical quality control.

Responsibilities




Audit datasets to identify annotation inconsistencies, missing labels, duplicate records, formatting issues, taxonomy violations, and policy deviations.
Compare annotations against project guidelines and gold-standard references.
Review AI-generated responses for factual accuracy, logical reasoning, safety compliance, hallucinations, and overall response quality where applicable.
Document quality trends, recurring error patterns, and reviewer performance metrics.
Provide structured feedback and coaching recommendations to annotators and reviewers.
Participate in calibration sessions to improve inter-rater reliability and annotation consistency.
Collaborate with project leads to refine annotation guidelines and quality assurance processes.

Requirements
Bachelor's degree in any discipline is preferred.
2+ years of experience in data quality assurance, annotation review, AI evaluation, quality auditing, content revie

📌 Data Quality Reviewer (Mumbai)
🏢 Deccan AI Experts
📍 Mumbai