Position: AI Evaluation Specialist

Type: Contract

Compensation: $20 - $35/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities:

- Build standalone evaluation exercises — prompts, reference materials, and thorough scoring guides — to measure how well AI systems handle real-world, computer-based tasks.
- Establish transparent-cut, written standards that distinguish successful outcomes from unsuccessful ones across a range of administrative and workflow use cases.
- Carefully monitor and record how AI agents behave, turning observations into clean, accurate summaries and reports written in polished English.
- Continuously improve evaluation tasks and grading criteria through feedback loops and teamwork, strengthening the overall benchmarking approach.
- Partner with the client's team to exchange findings and support ongoing advancement of AI evaluation practices.

Requirements

- Background in a field that relies on exact writing and organized thinking — for example,



paralegal work, executive assistance, junior analysis, library science, document archiving, research support, technical writing, or QA testing.
- Native-level or fluent English writing ability, with a track record of producing clear, specific, and unambiguous observations.
- Demonstrated experience creating or using rubrics, scoring against defined standards, or developing structured evaluation frameworks.
- Strong eye for detail, with the capacity to spot subtle patterns or discrepancies that others might overlook.
- Outstanding written and spoken communication skills, particularly for capturing nuanced feedback and observations.

Application Process

- Apply directly through LinkedIn's Easy Apply
- Watch your email for further instructions
- Complete a resume review and interview process

📌 AI Evaluation Specialist | $35/hr Remote (New Delhi)
🏢 Hireeing
📍 New Delhi