Hirely is recruiting experienced Python software engineers for a remote, task-based prospect focused on building datasets that teach AI agents to reason about real-world software codebases.

You will build challenging codebase-exploration tasks around production Python repositories. These tasks require engineers to investigate unfamiliar systems, understand runtime behavior, and develop questions and evaluation criteria that test deep engineering reasoning.

The work covers widely deployed Python codebases including Django, Twisted, Scrapy, SymPy, mypy, pip, coverage.py, mitmproxy, Certbot, Tornado, Werkzeug, sqlfluff, and Meson .

Key Responsibilities

- Select tasks from a pre-validated pool of Python repositories pinned to specific git commits.
- Explore repositories until you understand the relevant subsystem, including associated PR and issue history.
- Rewrite engineering questions to challenge advanced coding agents while remaining well-defined and answerable.
- Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers.
- Document completed work in the task README.
- Submit tasks for expert review and address reviewer feedback.

Qualifications

- 3+ years of professional software engineering experience with substantial production Python experience.
- Ability to navigate large, unfamiliar Python codebases and explain their runtime behavior.
- Strong understanding of relevant Python internals, including:
- Import machinery
- Descriptors and metaclasses




- Async and event loops
- Packaging
- C-extension boundaries
- Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant.
- Precise written English, as the questions and evaluation rubrics are a core part of the work.
- Comfortable working with Git at commit level, containerized environments, and command-line tooling.

Working Details

- Fully remote and asynchronous.
- Expert team leads operate across US, India, and Nigeria time zones.
- Time is tracked with Insightful.
- Platform access is provisioned through Okta.
- Onboarding includes identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and a short calibration quiz.
- Payment is $130 per approved task .
- Each task is reviewed by a second engineer and a super reviewer before acceptance.

Application Process Submit your resume or relevant technical background to get started. Qualified applicants may be asked to complete a brief technical assessment or provide additional information.

About Hirely

Hirely connects qualified professionals with remote opportunities offered by hiring partners across Artificial Intelligence, Software Engineering, Cloud, DevOps, Data, Research, and other specialized fields. Hirely may serve as a recruitment and talent-sourcing partner. Final hiring decisions, onboarding, compensation, and project assignments are determined by the hiring partner.

📌 Python Systems Software Engineer | $130/Task (India)
🏢 Hirely
📍 India