Grayde is a specialised healthcare and life science AI data and evaluation company. We work with the best clinicians and life science researchers to make medical AI models better.
Overview
Rank pairs of AI-generated responses as RLHF preference data, judging clinical accuracy, completeness, and appropriate sourcing against a scoring rubric.
About this job
We're seeking medical professionals - dentists, pharmacists, radiologists, nurses, oncologists etc to review and improve healthcare AI.
This is work from home which includes rating AI output, choosing the right answer, fact-checking, and writing training data.
What you'll do
- Rank multiple AI-generated drug information responses by quality to produce RLHF preference pairs.
- Verify dosing, interaction, and contraindication accuracy.
- Assess whether responses appropriately cite evidence or labelling.
- Use drug information databases such as DrugBank, Micromedex, Lexicomp, and FDA labelling to validate medication information.
- Check handling of off-label and unapproved-use questions.
- Flag responses that could mislead a prescriber or patient.
- Apply a structured rubric consistently across ranking batches.
- Write a comparative rationale explaining each preference judgment.