About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a robust founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems.

About the Role
We are seeking a Content Evaluator (Freelancer) to support advanced AI evaluation initiatives focused on content quality assessment, factual accuracy, instruction-following evaluation, safety review, and large language model (LLM) benchmarking.
In this role, you will review and evaluate AI-generated content across multiple formats, including text, documents, images, audio, video, and multimodal outputs. Your expertise will help improve next-generation AI systems by identifying quality issues, validating factual correctness, and providing structured feedback that enhances model performance.
This position is ideal for professionals with experience in content review, quality assurance, editorial review, AI evaluation, technical writing, research, journalism, education, or content moderation.

Responsibilities




Evaluate AI-generated content across multiple modalities, including:
Compare multiple AI-generated responses and rank them based on predefined quality guidelines.
Identify factual errors, unsupported claims, inconsistencies, reasoning failures, formatting issues, and policy violations.
Apply detailed evaluation rubrics to assign quality scores and document justification for evaluation decisions.
Review AI-generated summaries, translations, classifications, question-answer pairs, creative writing, analytical reports, and conversational responses.
Validate references, citations, structured outputs, and source-grounded content where applicable.
Document edge cases, ambiguous outputs, and recurring model failure patterns to support continuous model improvement.
Review peer evaluations and participate in calibration sessions to maintain high inter-rater reliability.
Meet quality, consistency, a

📌 Content Evaluator (India)
🏢 Deccan AI Experts
📍 India