- Design multi-step coding tasks grounded in visual material such as screenshots, UI mockups, and diagrams.
- Specify code and artifacts involved in tasks and define expected behavior.
- Define objective success criteria for task verification.
- Provide a working reference implementation for tasks.
- Review tasks built by other contributors for technical accuracy and verifiability.
- Flag ambiguous or ungradable tasks.
Requirements
- A public GitHub profile with substantial, verifiable contributions.
- Robust frontend engineering skills with React, TypeScript, or similar technologies.
- Experience shipping complex interfaces and interactions.
- Ability to read, modify, debug, and validate real application code.
- Experience with UI, graphics, SVG, or Canvas work is valuable.
- Strong written English and ability to explain expected behavior and verification steps.
- Prior data labeling, AI evaluation, or rubric-based review experience is a plus.