Hirely is recruiting on behalf of one of our hiring partners for a remote
Senior Software Engineer – Python
opportunity supporting a cutting-edge
LLM evaluation and AI training project
.
You’ll work with real-world open-source GitHub repositories and help build, validate, and evaluate software engineering tasks designed to improve the ability of next-generation AI models to understand, debug, and modify production-quality code.
What You'll Do:
As a Senior Software Engineer, you may:
- Analyze and triage issues across high-quality open-source GitHub repositories.
- Set up, configure, and Dockerize complex software repositories.
- Run, modify, debug, and test real-world codebases locally.
- Evaluate unit tests, test coverage, and overall test quality.
- Identify challenging software engineering problems suitable for LLM evaluation.
- Help create reproducible environments and reliable evaluation workflows.
- Assess LLM performance on realistic bug-fixing and software development tasks.
- Collaborate with AI researchers and engineering teams.
- Provide technical guidance and potentially mentor junior engineers.
What We're Looking For:
- 3+ years of professional software engineering experience.
- Strong
Python
development skills.
- Proficiency with
Git and Docker
.
- Ability to navigate and understand complex codebases.
- Experience debugging, modifying, and testing real-world software.
- Solid software engineering fundamentals and problem-solving skills.
- Excellent attention to detail and technical communication.
Preferred Qualifications:
- Experience contributing to or evaluating
open-source/GitHub projects
.
- Experience working with large or complex repositories.
- Previous experience with
LLM evaluation, AI research, or AI coding agents
.
- Experience building developer tools, testing frameworks, or automation systems.
- Experience leading or mentoring software engineers.
Compensation:
Compensation
📌 Senior Software Engineer (India)
🏢 Hirely
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.