- Create and solve advanced physics problems designed to evaluate and improve large language models.
- Develop clear, accurate, step-by-step solutions and high-quality benchmark data.
- Analyze AI-generated responses and identify errors in reasoning, calculations, and concepts.
- Collaborate with AI/LLM researchers to design evaluation tasks and benchmarks.
- Work across physics topics ranging from advanced undergraduate to PhD-level concepts.
- Provide detailed feedback and annotations to support AI model improvement.
- Work independently in a remote, task-based workplace while meeting quality and delivery requirements.
Preferred Candidate Profile:
- PhD or Doctorate in Physics, Applied Physics, or an equivalent technical field.
- Strong knowledge of physics and advanced problem-solving.
- Excellent analytical, research, and structured reasoning skills.
- Strong written English and ability to explain complex physics concepts clearly.
- Experience in AI evaluation, data annotation, content review, quality assurance, or similar analytical work is preferred but not mandatory.
- Comfortable working with AI/LLM-based tools and evaluating model responses.
- Self-motivated and able to work independently in a remote environment.
- Must have a personal laptop/desktop and reliable high-speed internet.
- Available for at least 4 hours per day, up to 40 hours per week, with 4 hours of PST overlap.