18 Nov
|
Codefeast
|
India
Lead Software Security Engineer – AI Coding Evaluation
Experience:
6+ Years
Job Type
Contract
Location:
Remote Domain: Software Security | Vulnerability Research | AI Coding Evaluation | Benchmark Development Role Overview We are looking for a Lead Software Security Engineer to lead a team developing high-quality training and evaluation tasks for frontier AI coding models. The role involves converting real-world CVEs, security advisories, and open-source vulnerabilities into realistic audit-and-patch tasks while ensuring solid security, reproducibility, verifier quality, and delivery standards.
Key Responsibilities
• Lead and manage trainers / Pod Leads across security task production.
• Plan task batches, assign work, and track daily throughput.
• Review completed tasks for security, quality, reproducibility, and evaluation accuracy.
• Calibrate teams on CWE classification, verifier robustness, task difficulty, and acceptance criteria. Key Requirements
• 6+ years of professional software engineering experience.
• Strong expertise in at least one of: Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
• Strong knowledge of CWE, CVE, OWASP Top 10, and software vulnerability analysis.
• Experience reproducing vulnerabilities and writing security tests.
• Hands-on experience with CodeQL, Semgrep, fuzzers, sanitizers, Git, Linux, Bash, and Docker. Selection Process
• Profile Review
• Technical AI Interview/Delivery review
• Final Review & Selection
📌 Senior Cyber Security Engineer (India)
🏢 Codefeast
📍 India