Vraify is hiring 30 experienced AI Evaluation Engineers to create and validate challenging simulation-based engineering design problems for evaluating advanced AI agents.

What you'll do:

- Design multi-constraint simulation-based tasks across electrical, mechanical, aerospace, control systems, systems engineering, and robotics.
- Configure open-source simulation tools and create objective automated graders.
- Analyze AI-agent execution logs and diagnose reasoning and tool-use failures.
- Validate challenging engineering-design problems for advanced AI evaluation.

Engagement details:

- Remote contractor engagement for up to 24 weeks; starts immediately.

Expected commitment:

- 40 hours per week, including at least 4 hours of overlap with Pacific Time (PST), plus weekend on-call availability.

Compensation: USD $500 per completed task. Each task is expected to require approximately 30–40 hours.

Eligibility: Candidates must be based in Bangladesh, India, Indonesia, Pakistan, Vietnam, Egypt, Ghana, Kenya, Nigeria, Turkey, Brazil, or Colombia.

Pay: ₹1,000.00 - ₹1,400.00 per hour

Work Location: Remote

📌 LLM - Engineering Expert (India)
🏢 Vraify
📍 India