Type: Contractor

Location: Remote

About the Opportunity:

Hirely is recruiting on behalf of one of our hiring partners for a remote Senior Software Engineer – Python opportunity supporting a cutting-edge LLM evaluation and AI training project .

You’ll work with real-world open-source GitHub repositories and help build, validate, and evaluate software engineering tasks designed to improve the ability of next-generation AI models to understand, debug, and modify production-quality code.

What You'll Do:

As a Senior Software Engineer, you may:

- Analyze and triage issues across high-quality open-source GitHub repositories.
- Set up, configure, and Dockerize complex software repositories.
- Run, modify, debug, and test real-world codebases locally.
- Evaluate unit tests, test coverage, and overall test quality.
- Identify challenging software engineering problems suitable for LLM evaluation.
- Help create reproducible environments and reliable evaluation workflows.
- Assess LLM performance on realistic bug-fixing and software development tasks.
- Collaborate with AI researchers and engineering teams.
- Provide technical guidance and potentially mentor junior engineers.

What We're Looking For:

- 3+ years of skilled software engineering experience.
- Strong Python development skills.
- Proficiency with Git and Docker .
- Ability to navigate and understand complex codebases.
- Experience debugging, modifying, and testing real-world software.
- Strong software engineering fundamentals and problem-solving skills.




- Excellent attention to detail and technical communication.

Preferred Qualifications:

- Experience contributing to or evaluating open-source/GitHub projects .
- Experience working with large or complex repositories.
- Previous experience with LLM evaluation, AI research, or AI coding agents .
- Experience building developer tools, testing frameworks, or automation systems.
- Experience leading or mentoring software engineers.

Compensation: Compensation varies depending on the hiring partner, project scope, experience, technical expertise, and assignment. Additional details regarding workload, engagement terms, and contract duration will be shared during the recruitment process.

Application Process:

Qualified candidates may go through:

1. Application and profile screening
2. Technical interview
3. Technical/cultural discussion
4. Project-specific evaluation
5. Final onboarding

About Hirely: Hirely is a recruitment and talent sourcing platform connecting skilled professionals with remote opportunities offered by trusted hiring partners across Artificial Intelligence, Software Engineering, Machine Learning, Data Science, Cloud Infrastructure, Research, and other specialized technical industries.

Important Information:

Hirely may serve as the recruitment or talent sourcing partner for this opportunity rather than the direct employer. Employment terms, compensation, onboarding, project assignments, and final hiring decisions are determined solely by the hiring partner.

📌 Senior Software Engineer - Python | LLM Evaluation & Repository Validation (India)
🏢 Hirely
📍 India