Location:
Remote Commitment: 10-40 hrs/week Role Responsibilities
- Investigate hard-to-find facts and verify information through credible sources.
- Design challenging research tasks to test AI models.
- Test AI model outputs and identify failures in search and reasoning.
- Analyze model search trajectories, source selection, and reasoning failures.
- Write explicit benchmark prompts and accurate, primary-source-backed answer keys. Requirements
- Possess strong relevant experience in investigative research, fact-checking, AI benchmark authoring, red-teaming, or technical QA.
- Have experience using AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity s Last Exam.
- Demonstrate strong web research and OSINT skills, including navigating academic archives, local records, and specialized databases.
- Capable of strong analysis of model search trajectories and failures.
- Strong writing skills to craft clear and accurate benchmark tasks. Application Process
- Apply via Easy Apply
- Check email for next steps
📌 AI Benchmark Task Writer | $10/hr Remote (India)
🏢 Crossing Hurdles
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.