17 Aug
|
CK-12 Foundation
|
Bengaluru
17 Aug
CK-12 Foundation
Bengaluru
About the Role
CK-12 () is on the lookout for talented, creative, and dedicated people to join our mission to provide great education to students around the world. We are looking for candidates to join our office in Bangalore as a Subject Matter Expert (Chemistry)
We have a solid education platform that has served over 352+ Million users, have got over 2.88+ Billion questions answered, and have more than 350 thousand customized Flexbooks. We have embarked on an exciting journey to build an AI-powered student tutor and Teacher Assistant to build the next generation of learning platforms.
We are hiring an AI Eval Engineer to build evaluation systems, tools, and workflows for AI-powered education products.
This is a hands-on technical role for someone who enjoys working with LLMs, writing scripts, analyzing model behavior, and building practical tools to improve AI quality. The role combines Python-based development, LLM workflow testing, rubric design, data analysis, and education-domain judgment.
You will work on AI systems used for tutoring, teacher support, content generation,
assessments, feedback, and student guidance. The goal is to measure and improve whether AI outputs are accurate, reliable, curriculum-aligned, pedagogically useful, age-appropriate, safe, and ready for real users.
Key Responsibilities
- Build and maintain evaluation pipelines for LLM-powered education workflows across student-facing and teacher-facing products.
- Write Python scripts, notebooks, and lightweight tools for batch testing, output analysis, model comparison, regression checks, and quality tracking.
- Create test sets, rubrics, golden datasets, annotation guidelines, and review workflows for evaluating AI outputs at scale.
- Evaluate and debug AI workflows involving prompts, structured outputs, retrieval, tool use, and multi-step reasoning.
- Analyze outputs to identify hallucinations, reasoning gaps, weak explanations, grade-level mismatches, regressions, and recurring failure pa
📌 Ai evaluation engineer (Bengaluru)
🏢 CK-12 Foundation
📍 Bengaluru