28 Sep
|
Codefeast
|
India
Domain Expert – AI Prompt Design & Evaluation
Experience: Professional / Domain Expertise Required
Job Type: Contractor
Schedule: Global - Flexible
Compensation: $50 per approved task
Role Overview
We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt , test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.
Key Responsibilities
- Convert a familiar, complex workflow into a challenging AI prompt .
- Test the prompt using ChatGPT and identify incomplete or incorrect outputs.
- Refine the task to better test the model’s reasoning capabilities.
- Record your screen, camera, and microphone while completing the task.
- Create a clear and comprehensive grading rubric .
- Submit the final prompt, failure notes, rubric, and generated output file.
Key Requirements
- Strong expertise in a specialized skilled or technical workflow .
- Ability to quickly evaluate the quality and accuracy of outputs in your domain.
- Strong reasoning, analytical, and problem-solving skills .
- Access to a laptop or desktop computer.
- Active ChatGPT account ; free tier is acceptable.
- Comfortable completing a screen-recorded session with audio and video .
Selection Process Step 1 – Application / Profile Submission
Step 2 – Paid Trial Assessment
Step 3 – Submission Review
Step 4 – Payment & Future Opportunities
📌 AI Evaluation Specialist | $50/Task (India)
🏢 Codefeast
📍 India