06 Aug
|
Crossing Hurdles
|
India
06 Aug
Crossing Hurdles
India
Position: Board Game Reasoning Expert (AI Training & Evaluation)
Type: Short-Term Contractor Assignment (2 Months)
Compensation: $150 per approved task
Location: Remote
Commitment: Up to 8 hours per day with 4 hours overlap with PST
Role Responsibilities
- Create and review board game and strategy-based reasoning datasets for AI evaluation
- Analyze game scenarios, strategic decision trees, and rule-based systems
- Evaluate AI-generated outputs for correctness, consistency, and reasoning quality
- Develop prompts, rubrics, and evaluation frameworks for game-focused tasks
- Identify logical errors, rule violations, and flawed reasoning
- Contribute to benchmark creation and quality assurance processes
- Collaborate with project teams to improve dataset quality and evaluation methodologies
Requirements
- Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field
- Demonstrated experience in board game design, playtesting, tabletop communities, or strategy-focused environments
- Solid understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems
- Background in game theory, behavioral economics, decision science, or formal logic
- Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems
- Excellent analytical, problem-solving, and written communication skills
Preferred Qualifications
- Experience with AI training, data annotation, prompt engineering, QA, or game design
- Experience creating evaluation rubrics, benchmark datasets, or quality frameworks
- Familiarity with Python, SQL, or data analysis tools
- Experience with LLM evaluation, RLHF, synthetic data generation, or AI benchmarking
Application Process
- Apply via Easy Apply and complete the application form shared by the recruitment team.
- Eligible candidates will receive a Take Home Assessment for further evaluation.
- Candidates who successfully clear the assessment will proceed to the Delivery Review stage.
- Shortlisted candidates will be contacted regarding onboarding requirements and next steps.
📌 Game Strategy Analyst | $15/hr Remote (India)
🏢 Crossing Hurdles
📍 India