About Dusker AI
Dusker AI specializes in developing high-quality benchmarks, evaluation frameworks, and real-world tasks to assess the capabilities of frontier AI models and autonomous agents.
Our work focuses on Terminal-Bench, SWE-Bench, coding agents, LLM evaluations, and agentic workflows, helping leading AI organizations measure reasoning, reliability, adaptability, robustness, and safety.
We go beyond traditional benchmark scores to investigate how AI systems perform in complex, real-world environments, identify critical failure modes, and develop more reliable evaluation methodologies.
As we expand our research capabilities, we are establishing a dedicated AI Benchmarks & Evaluations Research Group in Jaipur to advance the science of evaluating frontier AI systems.

Role Description
We are seeking a highly motivated Research Scientist – AI Benchmarks & Evaluations to lead research initiatives focused on designing, developing, and improving evaluation methodologies for large language models (LLMs), AI coding agents, and autonomous systems.This is a full-time,



on-site position based in Jaipur, India.
The Research Scientist will work with engineers, domain experts, and academic collaborators to develop challenging benchmarks, analyze frontier AI model performance, identify systematic failure patterns, and contribute original research to the broader AI community.
The role offers access to real-world benchmark datasets, agent execution traces, evaluation infrastructure, and computing resources to support rigorous experimentation and research.
A key objective will be to develop novel evaluation frameworks and publish meaningful research at leading AI conferences and workshops.

Key Responsibilities
• Benchmark Research & Development: Design cutting-edge benchmarks and evaluation tasks for frontier LLMs, AI coding agents, and autonomous systems, including Terminal-Bench and SWE-Bench-style environments.
• Evaluation Frameworks: Develop reliable, reproducible evaluatio

📌 Research Scientist – AI Benchmarks (Jaipur)
🏢 Dusker AI
📍 Jaipur