06 Apr
|
iMerit Technology
|
Kolkata
06 Apr
iMerit Technology
Kolkata
Apply on Kit Job: kitjob.in/job/46o0f3
Project Manager – GenAI Frontier Lab Strategic Delivery Role | Frontier Model Clients | Research-Driven AI Programs Role Snapshot This role leads high-ambiguity, research-intensive GenAI data programs for frontier AI labs.
n
The Project
n
Manager operates at the intersection of research intent and scalable execution, driving structured experimentation, quality governance, and operational excellence.
n
What Makes This Role
n
Critical for Frontier Clients - Operates in experiment cycles, not fixed-scope delivery models.
n
- Translates evolving research hypotheses into scalable execution workflows.
- Drives signal quality over raw volume.
- Partners directly with Research PMs, Safety Teams, and Evaluation Leads.
- Maintains delivery control amid rapid changes to rubrics and objectives. Core Responsibilities 1. Experiment-Driven Delivery Ownership - Convert research objectives into sprint-based execution plans.
- Manage SFT, RLHF, preference ranking, safety tuning, and evaluation datasets.
- Maintain experiment logs capturing intent, rubric shifts, and corrective actions. 2.
n
Client
n
Partnership & Governance - Act as the primary interface with frontier stakeholders.
n
- Run structured sprint reviews and executive updates.
- Surface risks, trade-offs, and improvement hypotheses proactively.
- Quality & Rubric Governance - Drive guideline version control and calibration systems.
- Implement layered QC (SME review, audits, gold sets).
- Lead root-cause analysis for model performance issues.
- Team Leadership & Capability Building - Lead TLs,
SMEs, QA, and large annotation teams.
- Ensure structured onboarding and continuous calibration.
- Monitor cognitive load and prevent quality fatigue.
- Metrics & Profitability Control - Track throughput, rework, guideline drift, and SLA adherence.
- Maintain cost discipline across iteration cycles.
- Protect margin during rapid scale transitions.
- Risk & Compliance Oversight - Enforce data confidentiality and IP protection.
- Mitigate bias risk, contamination risk, and safety mislabeling.
n
Required
n
Competencies - Strong governance mindset with structured thinking in ambiguous situations.
n
- Working knowledge of SFT, RLHF, evaluation pipelines, and safety labeling.
- Ability to convert evolving guidelines into scalable workflows.
- Executive-level communication and structured reporting capability.
- High ownership, accountability, and ethical judgment.
n
Qualifications - Bachelor’s degree required, preferably STEM
n
- 5–10 years of project/program delivery experience.
- Experience managing large-scale operational teams.
- Exposure to AI data annotation, NLP, or GenAI programs preferred.
- Experience working with US/EU stakeholders in rapid-paced environments preferred.
n
Success
n
Metrics (KPIs) - SLA adherence under evolving scope.
n
- Quality stability despite rubric changes.
- Reduction in rework and error clusters.
- Client trust and satisfaction score.
- Cost-per-unit stability during scale.
- Team retention and capability growth.
Apply on Kit Job: kitjob.in/job/46o0f3
📌 Project Manager – GenAI (Kolkata)
🏢 iMerit Technology
📍 Kolkata