About the Role
We are seeking an experienced Science Assessment Specialist to review, refine, and finalize AI-generated science questions designed for curriculum-aligned, international-standard assessments.
Our assessments emphasize scientific literacy, conceptual understanding, scientific inquiry, critical thinking, evidence-based reasoning, and the application of scientific knowledge to real-world situations.
This is a hands-on assessment development and quality assurance role. You will work with AI-powered question generation and evaluation systems, applying your expertise to ensure that questions are scientifically accurate, educationally meaningful, appropriately calibrated, and exam-ready.
We are looking for professionals with strong assessment experience, sound analytical judgment, and the ability to independently evaluate both questions and AI-generated recommendations.
Key Responsibilities
1. Assessment Item Review and Development
- Critically review AI-generated science questions for scientific accuracy, conceptual validity, clarity, and assessment quality.
- Identify weaknesses in question design, scientific explanations, answer options, experimental scenarios, and real-world contexts.
- Edit, rewrite, and refine questions, answer keys, and explanations to make them exam-ready.
- Evaluate whether questions assess the intended scientific competencies, concepts, and learning outcomes.
- Ensure questions are unambiguous, scientifically sound, and suitable for their intended assessment purpose.
- Assess the scientific plausibility, authenticity, and relevance of real-life situations, observations, experiments, and phenomena used in questions.
2. Curriculum Alignment and Difficulty Calibration
- Evaluate questions against the relevant science curriculum, grade-level learning objectives, and expected student competencies.
- Determine whether the difficulty level of a question is appropriate for the target grade, curriculum, and proficiency level.
- Distinguish between conceptual complexity, cognitive demand, required scientific knowledge, data interpretation, and difficulty arising from language or presentation.
- Identify questions that are too easy, too difficult, or otherwise unsuitable for the intended assessment level.
- Adjust questions to achieve the intended difficulty without compromising scientific accuracy or assessment validity.
- Recognize prerequisite knowledge and ensure questions do not unintentionally require concepts or scientific techniques beyond the intended curriculum.
- Help maintain an appropriate balance of difficulty levels, scientific competencies, and cognitive demands across assessments.
3. AI-Assisted Question Improvement
- Use AI tools and prompting techniques to generate, revise, and improve science assessment questions.
- Critically analyse AI-generated evaluations, feedback, and suggested improvements.
- Independently determine whether AI feedback is correct, relevant, unnecessary, or misleading.
- Accept, reject, or modify AI recommendations based on scientific accuracy, curriculum requirements, and sound assessment principles.
- Identify instances where AI misinterprets scientific concepts, misjudges question difficulty,
misunderstands the intended competency, or introduces errors during revision.
- Combine AI-assisted iteration with direct editorial improvements to deliver high-quality, exam-ready questions.
4. Scientific Reasoning and Assessment Quality
- Evaluate whether questions assess scientific understanding rather than simple factual recall.
- Assess questions involving scientific inquiry, experimental design, observations, hypotheses, data interpretation, and evidence-based conclusions.
- Check that scientific scenarios, experimental conditions, diagrams, graphs, tables, and supporting data are accurate and internally consistent.
- Identify misleading assumptions, scientifically invalid scenarios, unsupported conclusions, and incorrect interpretations of evidence.
- Evaluate whether questions appropriately assess students' ability to explain phenomena, interpret scientific evidence, and apply scientific concepts to unfamiliar situations.
- Ensure alignment with relevant international assessment principles, particularly those reflected in PISA, TIMSS, and comparable programmes.
5. Quality Assurance and Finalization
- Verify scientific explanations, correct answers, scoring guidelines, and the validity of alternative responses.
- Ensure that questions are appropriate for their intended student population, curriculum, and assessment objectives.
- Make final editorial decisions and take ownership of the quality of assigned questions.
- Document significant changes and provide concise, reasoned explanations for assessment decisions.
- Identify questions that cannot be satisfactorily improved and recommend their replacement.
Required Qualifications and Experience
- Minimum 5 years of relevant professional experience in science assessment development, item writing, item review, or assessment quality assurance.
- Demonstrable experience developing, reviewing, or validating curriculum-aligned science assessment questions.
- Strong understanding of science curricula, grade-level expectations, learning progressions, and competency-based assessment.
- Proven ability to evaluate and calibrate question difficulty and cognitive demand for different student proficiency levels.
- Experience working with application-oriented, context-based, or real-world science questions.
- Strong expertise in at least one major science discipline, such as Physics, Chemistry, Biology, or Earth and Environmental Science, with the ability to review questions within one's areas of expertise.
- Strong scientific reasoning, analytical thinking, and independent problem-solving abilities.
- Excellent attention to detail and ability to identify subtle scientific and assessment-design weaknesses.
- Ability to clearly explain and justify assessment decisions.
- Comfortable working with digital tools and willing to use AI-assisted assessment development systems.
Prior professional experience with AI tools is advantageous but not mandatory. Strong assessment expertise and independent judgment are essential.
Highly Preferred
- Direct experience with PISA, TIMSS, Cambridge International, IB, or comparable international assessment programmes.
- Experience with large-scale assessments, standardized testing, or international educational assessment organizations.
- Expertise in curriculum mapping, difficulty calibration, competency frameworks, and assessment blueprints.
- Familiarity with psychometric concepts, item difficulty analysis, item discrimination, scoring rubrics, and assessment validation.
- Experience developing questions involving scientific literacy, experimental reasoning, interpretation of evidence, data analysis, and the application of science to real-world situations.
- Experience reviewing interdisciplinary science questions that integrate multiple scientific concepts.
What We Value
We are particularly interested in professionals who can:
- Recognize when a scientifically correct question is nevertheless poorly designed.
- Accurately judge whether a question is easy, moderate, or challenging relative to its intended curriculum and student population.
- Understand that a good assessment requires appropriate difficulty, not maximum difficulty.
- Distinguish genuine scientific reasoning from unnecessary factual, computational, or linguistic complexity.
- Recognize when a question relies on unrealistic assumptions, misleading data, or scientifically implausible situations.
- Improve a question while preserving its intended learning objective and difficulty level.
- Critically challenge AI-generated feedback rather than accepting it unquestioningly.
- Identify when AI recommendations are helpful, unnecessary, or incorrect.
- Make well-reasoned decisions in ambiguous situations.
- Take ownership of producing complete, polished, exam-ready assessment items.
Important Eligibility Requirement
This position is specifically intended for experienced assessment professionals.
General science teaching experience or subject-matter expertise alone, without demonstrable professional experience in assessment item development, review, or validation, is insufficient.
Selection Process
Shortlisted candidates will complete a practical assessment involving AI-generated science questions.
The exercise will evaluate their ability to:
- Identify scientific, conceptual, and assessment-design weaknesses.
- Assess curriculum alignment, targeted scientific competencies, and appropriate difficulty levels.
- Evaluate AI-generated feedback and identify incorrect, misleading, or unnecessary recommendations.
- Improve questions through direct editing or AI-assisted prompting.
- Produce final, exam-ready questions while maintaining their intended learning objectives and difficulty.
- Clearly justify important assessment decisions.
How to Apply
Please submit your CV or LinkedIn profile, highlighting relevant assessment-development projects, curricula or international assessment programmes you have worked with, your areas of scientific expertise, and your specific responsibilities.
📌 Senior Science Assessment Specialist (Noida)
🏢 Cerebry
📍 Noida