18 Nov
|
Codefeast
|
India
Lead Software Security Engineer – AI Coding Evaluation
Experience: 6+ Years
Job Type: Contract
Location: Remote
Domain: Software Security | Vulnerability Research | AI Coding Evaluation | Benchmark Development
Role Overview
We are looking for a Lead Software Security Engineer to lead a team developing high-quality training and evaluation tasks for frontier AI coding models.
The role involves converting real-world CVEs, security advisories, and open-source vulnerabilities into realistic audit-and-patch tasks while ensuring strong security, reproducibility, verifier quality, and delivery standards.
Key Responsibilities
- Lead and manage trainers / Pod Leads across security task production.
- Plan task batches, assign work, and track daily throughput.
- Review completed tasks for security, quality, reproducibility, and evaluation accuracy.
- Calibrate teams on CWE classification, verifier robustness, task difficulty, and acceptance criteria.
Key Requirements
- 6+ years of skilled software engineering experience.
- Strong expertise in at least one of: Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
- Strong knowledge of CWE, CVE, OWASP Top 10, and software vulnerability analysis.
- Experience reproducing vulnerabilities and writing security tests.
- Hands-on experience with CodeQL, Semgrep, fuzzers, sanitizers, Git, Linux, Bash, and Docker.
Selection Process
1. Profile Review
2. Technical AI Interview/Delivery review
3. Final Review & Selection
📌 Senior Cyber Security Engineer (India)
🏢 Codefeast
📍 India