Hirely is recruiting on behalf of a hiring partner for a remote AI Engineer opportunity supporting next-generation AI training and software engineering evaluation projects. Contributors will help build Reinforcement Learning environments that evaluate how AI agents solve complex software engineering problems using Model Context Protocol (MCP) tools. Work will involve creating realistic coding challenges, deterministic verification systems, and reference solutions.
What You’ll Do:
- Design realistic software engineering tasks for AI agents.
- Build Reinforcement Learning environments that evaluate AI models on complex coding problems.
- Create tasks involving bug fixing, feature implementation, codebase refactoring, and performance optimization .
- Design environments where AI agents must discover and reason over information from real MCP servers.
- Develop deterministic verification systems to reliably evaluate agent outputs.
- Create golden/reference solutions for software engineering tasks.
- Evaluate AI-generated implementations for correctness, quality, and performance.
- Work with complex codebases and identify bugs, edge cases, and optimization opportunities.
- Maintain high standards for reproducibility, correctness, and technical quality.
Who We’re Looking For:
- Strong programming experience in one or more of: Python, Java, C++, Go, Rust, TypeScript.
- Strong understanding of algorithms and data structures .
- Experience debugging complex software issues.
- Solid experience with feature development and codebase refactoring.
- Experience optimizing software for performance and scalability.
- Ability to understand and work with unfamiliar codebases.
- Strong written and verbal English communication.
- Excellent attention to detail.
- Experience collaborating with remote or distributed engineering teams.
Preferred Qualifications:
- Experience with large-scale or distributed codebases.
- Familiarity with AI/ML systems or AI agents .
- Experience with MCP or tool-using AI agents is a plus.
- Strong code review and software engineering best-practice experience.
- Experience with rigorous testing and automated verification.
Compensation & Time Commitment:
- $60-$120/hour equivalent
- Approximately 15 hours per week
- Adaptable schedule
- Fully remote contractor opportunity.
Application Process:
1. Submit your application and screening questions.
2. Complete an approximately 30-minute AI interview .
3. Complete a technical assessment if required.
4. Final hiring manager review.
About Hirely: Hirely connects qualified professionals with remote opportunities offered by hiring partners across Artificial Intelligence, Software Engineering, Machine Learning, Data Science, and other technology fields. Hirely may serve as a recruitment and talent-sourcing partner. Final hiring decisions, onboarding, compensation, and project assignments are determined solely by the hiring partner.
📌 AI Engineer (India)
🏢 Hirely
📍 India