04 Apr
|
Important Company of the Sector
|
Raipur
04 Apr
Important Company of the Sector
Raipur
Apply on Kit Job: kitjob.in/job/463i4z
Project Manager – Gen AI Frontier Lab
n
Strategic Delivery Role | Frontier Model Clients | Research-Driven AI Programs
n
Role Snapshot
n
This role leads high-ambiguity, research-intensive Gen AI data programs for frontier AI labs. The Project Manager operates at the intersection of research intent and scalable execution, driving structured experimentation, quality governance, and operational excellence.
n
What Makes This Role Critical for Frontier Clients
n
Operates in experiment cycles, not fixed-scope delivery models.
n
Translates evolving research hypotheses into scalable execution workflows.
n
Drives signal quality over raw volume.
n
Partners directly with Research PMs, Safety Teams, and Evaluation Leads.
n
Maintains delivery control amid rapid changes to rubrics and objectives.
n
Core Responsibilities
n
- Experiment-Driven Delivery Ownership
n
Convert research objectives into sprint-based execution plans.
n
Manage SFT, RLHF, preference ranking, safety tuning, and evaluation datasets.
n
Maintain experiment logs capturing intent, rubric shifts, and corrective actions. 2. Client Partnership & Governance
n
Act as the primary interface with frontier stakeholders.
n
Run structured sprint reviews and executive updates.
n
Surface risks, trade-offs, and improvement hypotheses proactively. 3. Quality & Rubric Governance
n
Drive guideline version control and calibration systems.
n
Implement layered QC (SME review, audits, gold sets).
n
Lead root-cause analysis for model performance issues. 4. Team Leadership & Capability Building
n
Lead TLs, SMEs, QA, and large annotation teams.
n
Ensure structured onboarding and continuous calibration.
n
Monitor cognitive load and prevent quality fatigue. 5. Metrics & Profitability Control
n
Track throughput, rework, guideline drift, and SLA adherence.
n
Maintain cost discipline across iteration cycles.
n
Protect margin during rapid scale transitions. 6. Risk & Compliance Oversight
n
Enforce data confidentiality and IP protection.
n
Mitigate bias risk, contamination risk, and safety mislabeling.
n
Required Competencies
n
Strong governance mindset with structured thinking in ambiguous situations.
n
Working knowledge of SFT, RLHF, evaluation pipelines, and safety labeling.
n
Ability to convert evolving guidelines into scalable workflows.
n
Executive-level communication and structured reporting capability.
n
High ownership, accountability, and ethical judgment.
n
Qualifications
n
Bachelor’s degree required, preferably STEM
n
5–10 years of project/program delivery experience.
n
Experience managing large-scale operational teams.
n
Exposure to AI data annotation, NLP, or Gen AI programs preferred.
n
Experience working with US/EU stakeholders in quick-paced environments preferred.
n
Success Metrics (KPIs)
n
SLA adherence under evolving scope.
n
Quality stability despite rubric changes.
n
Reduction in rework and error clusters.
n
Client trust and satisfaction score.
n
Cost-per-unit stability during scale.
n
Team retention and capability growth.
Apply on Kit Job: kitjob.in/job/463i4z
📌 Project manager – genai (Raipur)
🏢 Important Company of the Sector
📍 Raipur