We are looking for an experienced Strategic Project Lead with hands-on experience operating software-engineering data programs for frontier AI models.

This is a highly specialized role for professionals who have managed production programs involving coding data, SWE benchmarks, model evaluations, RLHF/preference data, agentic coding, code generation, or code-repair datasets.

What You'll Do

- Operate software-engineering data and evaluation programs end to end.

- Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.

- Track throughput, quality, rework, defects, costs, and delivery timelines.

- Review code, tests, task metadata, and final artifacts for technical correctness.

- Diagnose quality failures and improve task design, rubrics, instructions, and review processes.

- Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.

- Coordinate distributed software engineers, reviewers, and team leads.

- Communicate progress, risks, and corrective actions to research and program teams.

- Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

What We're Looking For





- Direct experience operating production software-engineering data programs for frontier AI models.

- Experience with coding training, coding RLHF, SWE benchmarks, model evaluations, agentic coding, code generation, or code repair.

- Proven ownership of contributor sourcing and calibration, throughput, quality, rework, cost management, and delivery recovery.

- Robust software-engineering judgment and the ability to read code and tests, inspect final artifacts, and identify invalid technical work.

- Experience managing distributed software engineers, reviewers, and team leads.

- Ability to quickly take ownership of an active program, diagnose operational issues, and develop recovery plans.

- A LinkedIn profile is required for review.

Project Details

- Role: Strategic Project Lead – Software Engineering

- Type: Short-term Contractor

- Duration: 3 months

- Start: Immediate

- Locations: USA, Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Nigeria, Turkey, Vietnam

- Availability: 8 hours/day, minimum 40 hours/week

- Time Zone: Minimum 4-hour overlap with PST

📌 Strategic Project Lead – Software Engineering (India)
🏢 Consultbae India
📍 India