We are looking for an experienced Exam/Assessment Developer to design, develop, and manage certification and assessment exams. The ideal candidate will possess strong expertise in exam development methodologies, psychometrics, instructional design, and project management. This role involves collaborating with Subject Matter Experts (SMEs) to create valid, reliable, and legally defensible assessments while ensuring adherence to industry best practices.
Key Responsibilities
- Conduct Job Task Analysis (JTA) to identify knowledge, skills, and abilities required for certification exams.
- Develop exam blueprints and test definition documents.
- Facilitate workshops with Subject Matter Experts (SMEs) to create high-quality assessment content.
- Write, review, revise, and validate multiple-choice exam questions.
- Ensure assessment content aligns with psychometric principles and cognitive learning objectives.
- Coordinate technical reviews and maintain the accuracy and relevance of exam content.
- Plan and execute beta exams and analyze candidate feedback.
- Work with psychometric vendors to perform statistical analysis, establish passing scores, and finalize exam items.
- Track project timelines and ensure timely delivery of assigned exam development activities.
- Maintain confidentiality and security of assessment content.
- Manage exam content using item banking and assessment authoring tools.
- Collaborate with cross-functional stakeholders to continuously improve the certification program.
Required Skills & Qualifications
- 4+ years of experience in exam development, educational assessment, certification, or related project management.
- Strong understanding of psychometric principles and the exam development lifecycle.
- Experience conducting Job Task Analysis (JTA) and developing exam objectives.
- Proven experience writing and reviewing multiple-choice assessment questions.
- Excellent stakeholder management and communication skills.
- Ability to manage virtual teams and coordinate with global SMEs.
- Robust project management skills with the ability to manage multiple priorities.
- Bachelor's or Master's degree in:
- Psychometrics
- Industrial & Organizational Psychology
- Educational Assessment
- Instructional Design
- Or an equivalent discipline.
Preferred Qualifications
- Experience in IT or Software Certification programs.
- Familiarity with Microsoft Project, OmniPlan, or similar project management tools.
- Experience using assessment authoring or item banking tools (e.g., Item Workshop, CERTS, Benchmark).
- Knowledge of standard-setting methodologies such as Modified Angoff or Hofstee.
- Experience designing assessments for technical or soft skills.