20 Oct
|
Curvia AI
|
India
Company Description: Curvia AI is a London, UK-based technology and AI solutions company that transforms complexity into opportunity through enterprise solutions, AI-powered automation, and data-driven insights. We build practical, scalable, and human-centered technology grounded in integrity, security, and responsible innovation.
Role Overview
We are seeking an analytical researcher and red-teaming specialist to build evidence-based web-research benchmark tasks that reliably expose weaknesses in state-of-the-art (SOTA) AI models (e.g., Claude Opus 5 Max). In this role, you will discover hard-to-surface facts, build exact research tasks around them, test them directly against leading LLMs, and diagnose the exact failure mechanisms in the model's search and reasoning paths.
Your work will directly shape AI evaluation frameworks, ensuring next-generation frontier models are tested against rigorous, non-trivial real-world research scenarios.
Offer Details:
• Compensation: US $60 per task AHT: 6 hours
• Commitments Required: Full Time Availability(8 Hrs)
and 4 hours overlap with the PST time zone
• Employment type: Contractor assignment (no medical/paid leave)
• Contract length: 4 weeks (with possible Extension)
• Mode of Work: Fully Remote
• Number of positions: 180
• Years Of Experience: 1+ years.
Job Requirements:
• Core Experience: 1+ years in investigative research, fact-checking, AI benchmark task authoring, red-teaming, or technical QA review.
• Benchmark Familiarity: Proven experience authoring, testing, or reviewing tasks for AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity’s Last Exam (HLE).
• Analytical & OSINT Skills: Intermediate-to-advanced web search and Open Source Intelligence (OSINT) skills; ability to navigate academic archives, local records, or obscure databases.
• Model Trajectory Debugging: Strong analytical capability to inspect model reasoning chains, search logs, and source selection to diagnose roo
📌 Task Reviewer | Remote (India)
🏢 Curvia AI
📍 India