08 Oct
|
Shift
|
Bengaluru
About shift
shift pays everyday workers to record short videos of the tasks they already do (in kitchens, workshops, job sites, bakeries, and warehouses) to help train the next generation of AI and robotics. We’ve paid out over $15M to 25,000+ workers across 15+ countries.
About the role
You're the standard other reviewers calibrate against. You audit egocentric video annotation -segmentation, per-hand text labels, hand tracking, object identification - and judge whether thework on camera is real. You still annotate at gold standard yourself. When an edge case has no answer yet, you decide, and you write it down so nobody decides it twice.
What you'll do
• Annotate at gold standard; build and document the golden clips others are measured against
• Rate and calibrate annotators; give feedback specific enough to move their scores
• Adjudicate escalated edge cases and turn each ruling into a rubric or SOP update
• Audit annotation labeling output - in-house and vendor - and own the accept/reject call
• Own the fake-versus-real call: spot staged, faked, or non-genuine task footage,
and sharpen the criteria that let others spot it too
• Review machine-generated hand tracking - keypoint accuracy, left/right attribution, hand-object contact - and flag systematic failure modes
• Lead calibration sessions and onboarding for recent reviewers
• Surface disagreement patterns and quality trends to the Annotation Quality Lead
What we're looking for
• B.E./B.Tech or Diploma in Automobile or Mechanical Engineering, with a robust grasp of vehicle systems, diagnostics, and repair procedures. Robotics/Mechatronics graduates with genuine automotive exposure are also welcome.
• Outstanding written English and communication. Your labels are commands a model learns from, and your feedback has to land with the person receiving it
• You can explain what a 99% versus 95% bar means in practice - and work to it
• 3+ years of hands-on video annotation, with meaningful time on egocentric/first-p
📌 Ai Trainer Bengaluru
🏢 Shift
📍 Bengaluru