About the Role
We are seeking an experienced Science Assessment Specialist to review, refine, and finalize AI-generated science questions designed for curriculum-aligned, international-standard assessments. Our assessments emphasize scientific literacy, conceptual understanding, scientific inquiry, critical thinking, evidence-based reasoning, and the application of scientific knowledge to real-world situations. This is a hands-on assessment development and quality assurance role. You will work with AI-powered question generation and evaluation systems, applying your expertise to ensure that questions are scientifically accurate, educationally meaningful, appropriately calibrated, and exam-ready. We are looking for professionals with strong assessment experience, sound analytical judgment, and the ability to independently evaluate both questions and AI-generated recommendations.
Key Responsibilities
1. Assessment Item Review and Development
• Critically review AI-generated science questions for scientific accuracy, conceptual validity, clarity, and assessment quality.
• Identify weaknesses in question design, scientific explanations, answer options, experimental scenarios, and real-world contexts.
• Edit, rewrite, and refine questions, answer keys, and explanations to make them exam-ready.
• Evaluate whether questions assess the intended scientific competencies, concepts, and learning outcomes.
• Ensure questions are unambiguous, scientifically sound, and suitable for their intended assessment purpose.
• Assess the scientific plausibility, authenticity, and relevance of real-life situations, observations, experiments, and phenomena used in questions. 2. Curriculum Alignment and Difficulty Calibration
• Evaluate questions against the relevant science curriculum, grade-level learning objectives, and expected student competencies.
• Determine whether the difficulty level of a question is appropriate for the target grade, curriculum, and proficiency level.
• Distinguish between conceptual complexity, cognitive demand, required scientific knowledge, data interpretation, and difficulty arising from language or presentation.
• Identify questions that are too easy, too difficult, or otherwise unsuitable for the intended assessment level.
• Adjust questions to achieve the intended difficulty without compromising scientific accuracy or assessment validity.
• Recognize prerequisite knowledge and ensure questions do not unintentionally require concepts or scientific techniques beyond the intended curriculum.
• Help maintain an appropriate balance of difficulty levels, scientific competencies, and cognitive demands across assessments. 3. AI-Assisted Question Improvement
• Use AI tools and prompting techniques to generate, revise, and improve science assessment questions.
• Critically analyse AI-generated evaluations, feedback, and suggested improvements.
• Independently determine whether AI feedback is correct, relevant, unnecessary, or misleading.
• Accept, reject, or modify AI recommendations based on scientific accuracy, curriculum requirements, and sound assessment principles.
• Identify instances where AI misinterprets scientific concepts, misjudges question difficulty,
misunderstands the intended competency, or introduces errors during revision.
• Combine AI-assisted iteration with direct editorial improvements to deliver high-quality, exam-ready questions. 4. Scientific Reasoning and Assessment Quality
• Evaluate whether questions assess scientific understanding rather than simple factual recall.
• Assess questions involving scientific inquiry, experimental design, observations, hypotheses, data interpretation, and evidence-based conclusions.
• Check that scientific scenarios, experimental conditions, diagrams, graphs, tables, and supporting data are accurate and internally consistent.
• Identify misleading assumptions, scientifically invalid scenarios, unsupported conclusions, and incorrect interpretations of evidence.
• Evaluate whether questions appropriately assess students' ability to explain phenomena, interpret scientific evidence, and apply scientific concepts to unfamiliar situations.
• Ensure alignment with relevant international assessment principles, particularly those reflected in PISA, TIMSS, and comparable programmes. 5. Quality Assurance and Finalization
• Verify scientific explanations, correct answers, scoring guidelines, and the validity of alternative responses.
• Ensure that questions are appropriate for their intended student population, curriculum, and assessment objectives.
• Make final editorial decisions and take ownership of the quality of assigned questions.
• Document significant changes and provide concise, reasoned explanations for assessment decisions.
• Identify questions that cannot be satisfactorily improved and recommend their replacement. Required Qualifications and Experience
• Minimum 5 years of relevant professional experience in science assessment development, item writing, item review, or assessment quality assurance.
• Demonstrable experience developing, reviewing, or validating curriculum-aligned science assessment questions.
• Strong understanding of science curricula, grade-level expectations, learning progressions, and competency-based assessment.
• Proven ability to evaluate and calibrate question difficulty and cognitive demand for different student proficiency levels.
• Experience working with application-oriented, context-based, or real-world science questions.
• Strong expertise in at least one major science discipline, such as Physics, Chemistry, Biology, or Earth and Environmental Science, with the ability to review questions within one's areas of expertise.
• Strong scientific reasoning, analytical thinking, and independent problem-solving abilities.
• Excellent attention to detail and ability to identify subtle scientific and assessment-design weaknesses.
• Ability to clearly explain and justify assessment decisions.
• Comfortable working with digital tools and willing to use AI-assisted assessment development systems.
Prior professional experience with AI tools is advantageous but not mandatory. Robust assessment expertise and independent judgment are essential. Highly Preferred
• Direct experience with PISA, TIMSS, Cambridge International, IB, or comparable international assessment programmes.
• Experience with large-scale assessments, standardized testing, or international educational assessment organizations.
• Expertise in curriculum mapping, difficulty calibration, competency frameworks, and assessment blueprints.
• Familiarity with psychometric concepts, item difficulty analysis, item discrimination, scoring rubrics, and assessment validation.
• Experience developing questions involving scientific literacy, experimental reasoning, interpretation of evidence, data analysis, and the application of science to real-world situations.
• Experience reviewing interdisciplinary science questions that integrate multiple scientific concepts. What We Value We are particularly interested in professionals who can:
• Recognize when a scientifically correct question is nevertheless poorly designed.
• Accurately judge whether a question is easy, moderate, or challenging relative to its intended curriculum and student population.
• Understand that a good assessment requires appropriate difficulty, not maximum difficulty.
• Distinguish genuine scientific reasoning from unnecessary factual, computational, or linguistic complexity.
• Recognize when a question relies on unrealistic assumptions, misleading data, or scientifically implausible situations.
• Improve a question while preserving its intended learning objective and difficulty level.
• Critically challenge AI-generated feedback rather than accepting it unquestioningly.
• Identify when AI recommendations are useful, unnecessary, or incorrect.
• Make well-reasoned decisions in ambiguous situations.
• Take ownership of producing complete, polished, exam-ready assessment items. Important Eligibility Requirement This position is specifically intended for experienced assessment professionals. General science teaching experience or subject-matter expertise alone, without demonstrable professional experience in assessment item development, review, or validation, is insufficient. Selection Process Shortlisted candidates will complete a practical assessment involving AI-generated science questions. The exercise will evaluate their ability to:
• Identify scientific, conceptual, and assessment-design weaknesses.
• Assess curriculum alignment, targeted scientific competencies, and appropriate difficulty levels.
• Evaluate AI-generated feedback and identify incorrect, misleading, or unnecessary recommendations.
• Improve questions through direct editing or AI-assisted prompting.
• Produce final, exam-ready questions while maintaining their intended learning objectives and difficulty.
• Clearly justify important assessment decisions.
How to Apply
Please submit your CV or LinkedIn profile, highlighting relevant assessment-development projects, curricula or international assessment programmes you have worked with, your areas of scientific expertise, and your specific responsibilities.
📌 Senior Science Assessment Specialist (Noida)
🏢 Cerebry
📍 Noida