You will judge what a language model produces - ranking responses, applying safety policy and writing the preference data that model training runs on. The work is careful reading and consistent judgement, at volume, against a rubric that keeps moving as the policy sharpens.
What you will do
- Review and rank model responses for helpfulness, accuracy and safety against a written rubric.
- Apply trust safety policy to borderline content and record why a call was made, not only what it was.
- Flag rubric gaps and recurring ambiguity so the guideline gets fixed rather than worked around.
- Take part in calibration sessions and golden-set checks that keep judgement consistent across the team.
- Maintain the quality bar under deadline without drifting from the rubric.
What you will bring
- Strong reading comprehension and written English - this is the core skill of the role.
- Evident care with detail and the patience for repetitive, judgement-heavy work.
- Willingness to have your judgement measured, discussed and corrected in calibration.
- A bachelors degree in any discipline, or equivalent experience. This role is open to candidates early in their career; the training is provided.
- Helpful, not required: content moderation, editorial, teaching, linguistics or translation experience, or a second Indian language.
Working arrangements
Full time, on site at the delivery centre listed above. Standard working hours, with shift cover arranged within the team where a client programme runs to a different timezone.
About DesiCrew
DesiCrew has run high-stakes AI and enterprise operations from small-town and rural India since 2007. More than 2,000 people work across our delivery centres, 68% of them women - roughly twice the industry average - and 49% the sole earner in their family. We are ISO 9001, ISO 27001 and ISO 42001 certified and a Excellent Place to Work.
We hire for aptitude and train for the rest. DTOUCH, our in-house learning platform, has delivere
📌 RLHF Quality Analyst (Chennai)
🏢 Desicrew Solutions
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.