Applied Health & Medicine Benchmark Specialist

Position: Applied Health & Medicine Benchmark Specialist

Type: Hourly Contract

Compensation: $94–$119/hour

Location: Remote

About the Opportunity
This opportunity is for experienced medical and health science professionals to contribute their expertise to an advanced AI research and evaluation project with Mercor.
You will author and verify high-quality academic assessment content across clinical medicine, surgery, medical imaging and diagnostics, pharmacovigilance, healthcare management and economics, rehabilitation, and allied health. The work focuses on developing rigorous benchmarks that evaluate AI systems on deep conceptual understanding, clinical reasoning, accuracy, and professional judgment.
Experts with advanced knowledge in relevant health and medicine domains are encouraged to apply.
Responsibilities
- Develop original, challenging health and medicine multiple-choice questions that assess deep conceptual understanding rather than surface-level recall.
- Create realistic assessment scenarios across clinical medicine,



surgery, diagnostics, pharmacovigilance, healthcare management, rehabilitation, and allied health.
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives for each question.
- Ensure questions are self-contained, unambiguous, precise, and appropriately challenging.
- Rate each question according to difficulty: Medium, Hard, or Expert.
- Develop explicit, step-by-step solutions explaining the correct reasoning and answer.
- Provide 1–5 reputable academic references for each question, including peer-reviewed research and clinical guidelines.
- Review and verify pre-written questions for medical accuracy, clarity, completeness, precision, and solvability.
- Identify and correct inaccurate, ambiguous, or unsupported content.
- Document and justify any modifications made during the verification process.
- Evaluate AI-generated health and medical responses and identify technical

📌 Health & Medicine Expert (Remote | $94–$119/hr) (Kolhapur)
🏢 Synthires
📍 Kolhapur