THE ROLE

You own the quality of our annotated language data, and the capability of the annotators who produce it. You decide what "correct" looks like, write it down clearly enough that a team can apply it consistently, and train them until the output holds up. When quality slips, you fix the cause - not just the error.

WHAT YOU WILL DO -

Own annotation quality metrics: accuracy, error trend,

-Design and run QA - sampling plans, audit cadence, gold-standard test sets.

- Write and maintain annotation guidelines, label definitions and edge-case documentation. - Act as final adjudicator on ambiguous annotations, and document the reasoning.
- Build and run annotator onboarding: training material, worked examples, certification before going live.
- Run calibration sessions and coach annotators using their own error data. - Report quality performance to stakeholders and flag risks to data reliability early.

WHAT WE ARE LOOKING FOR

Must have

- 2+ years of hands-on annotation,



labelling or linguistic data experience.
- Experience in a QA, review or senior annotator capacity - audits, second-pass review, adjudication or guideline authoring.
- Native command of at least one language, plus skilled English.
- Strong written communication - guidelines and feedback are the core of this job.
- Comfort with quality data: agreement rates, error breakdowns, sampling.

Good to have

- Qualification in linguistics, languages, literature or translation.
- Experience training or mentoring annotators.
- Familiarity with tools like annotation platforms
- Exposure to LLM annotation work - prompt writing, response evaluation, RLHF.
- Additional Indian languages.

Application Question(s)
- Are you willing to relocate to either Bengaluru or Noida?

Location:
- Bengaluru, Karnataka (Preferred)

Work Location: In person

📌 Language QC lead - Marathi (Bengaluru)
🏢 2une by PhysicsWallah
📍 Bengaluru