Job Description

About the Role

Chegg is building the next generation AI Evaluation Platform to keep improving learner experience across product and services from copilots to autonomous agents. As we scale our use of large language models and agentic systems, the quality, safety, and reliability of these systems depend on rigorous, well-designed evaluations. We're hiring a Senior Engineer to own the design and implementation of evaluation frameworks ("evals") that measure model and agent performance across accuracy, reasoning, safety, and pedagogical quality — and that directly inform how we train, fine-tune, and ship AI systems.

This is a high-leverage, cross-functional role sitting at the intersection of ML research, data engineering, and product. You'll own evaluation solutions end-to-end — from framework design through deployment and production monitoring — partnering closely with ML researchers, applied scientists, and product teams to define what "valuable" looks like for models and agents and turn measurements into actionable outcomes.

What You'll Do





• Own evaluation solutions end-to-end: design the methodology, build the pipeline and tooling, deploy it into training and production workflows, and maintain/iterate on it over time — with minimal hand-off to other teams.
• Design and build evaluation frameworks and harnesses for LLMs and multi-step AI agents, covering offline benchmarks, online/production evals, and human-in-the-loop review.
• Define rubrics and scoring methodologies for open-ended tasks (e.g., tutoring quality, step-by-step reasoning, citation accuracy) where correctness isn't binary.
• Build automated, model-graded (LLM-as-judge) and rule-based evaluators, and validate them against human judgment for reliability and bias.
• Develop agent-specific evaluations: tool-use correctness, multi-turn task completion, planning/trajectory quality, failure recovery, and cost/latency tradeoffs.
• Create golden datasets, adversarial test sets, and regressio

📌 Senior Software Engineer (India)
🏢 Chegg India
📍 India