About The Role

What if the code you write could determine how smart the next generation of AI truly is? We're looking for experienced Software Engineers to design and build the coding benchmarks and data pipelines used to evaluate frontier AI models — the systems that decide whether an AI can actually reason, debug, and write production-quality software.

This is high-impact, technically demanding work at the intersection of software engineering and AI research. You'll work with large codebases, multiple programming languages, and scalable infrastructure to create evaluation systems that push the boundaries of what AI can do.

This is a fully remote contract role. If you thrive in rapid-paced engineering environments and want your work to directly shape the trajectory of AI — this is the role.

Organization: Alignerr
Type: Hourly Contract
Location: Remote
Contract Length: 3 Months
Commitment: Full-time availability preferred

What You'll Do

Design and implement coding benchmarks used to evaluate frontier AI models across real-world programming tasks




Build and maintain scalable data pipelines for AI evaluation workflows
Analyze AI-generated code for correctness, reliability, and edge-case failures
Create structured evaluation scenarios that rigorously test reasoning, debugging, and code quality
Work with large code repositories and multi-language environments
Collaborate on systems that improve how AI models understand and generate software
Provide detailed technical feedback on model performance and failure patterns
Contribute to the design of evaluation frameworks that set industry standards

Who You Are

4+ years of professional software engineering experience — this is non-negotiable
Experience working at a high-growth tech company or top-tier software organization
Expert proficiency in Python — you write clean, performant, well-tested Python code
Hands-on experience with code repositories and working in large, complex codebases
Proven experience designing and i

📌 Senior Software Engineer — AI Evaluation (India)
🏢 Alignerr
📍 India