About The Company

Quik Hire Staffing is a premier recruitment agency dedicated to connecting talented professionals with leading organizations across various industries. With a focus on quality and integrity, we strive to deliver personalized staffing solutions that meet the unique needs of our clients and candidates. Our extensive network and industry expertise enable us to identify top-tier talent for both emerging startups and established enterprises.

Committed to fostering diversity and inclusion, Quik Hire Staffing ensures that every candidate is evaluated fairly and transparently, promoting equal opportunities in the workforce.

About The Role

We are currently seeking a highly skilled Software Engineer specializing in Ruby to join our client's innovative team remotely. The role centers on evaluating and improving large language models (LLMs) through building robust evaluation datasets and repository validation. As a key contributor, you will work on developing datasets that simulate real-world software engineering challenges, utilizing synthetic methods and human-in-the-loop processes to create verifiable tasks from public repository histories.

This position offers a unique prospect to influence AI development in the software engineering domain, working on cutting-edge projects that enhance AI's understanding and interaction with complex codebases.

Qualifications The ideal candidate will possess a minimum of three years of professional experience in software engineering with a strong command of Ruby and Ruby on Rails. You should have demonstrated expertise in managing code repositories, setting up development environments, and utilizing containerization tools such as Docker. Familiarity with Git for version control and experience with software pipeline setup for reproducible testing are essential.

Candidates should have hands-on experience with Ruby testing frameworks like RSpec and Minitest, as well as gem management tools such as Bundler.



An understanding of code quality tooling and prior contributions to open-source projects will be considered advantageous. Excellent problem-solving skills, attention to detail, and the ability to navigate complex codebases are essential for success in this role.

Responsibilities

- Analyze and triage issues from trending open-source libraries on GitHub to identify suitable scenarios for evaluation.
- Configure and set up code repositories, including creating Docker containers and preparing environments to ensure reproducible testing conditions.
- Assess unit test coverage and quality metrics to determine the baseline health of codebases and the robustness of test suites.
- Modify, run, and debug Ruby codebases locally to evaluate the performance of large language models in bug fixing and code completion tasks.
- Collaborate closely with AI researchers to select repositories and issues that challenge LLMs, contributing to the design of evaluation datasets and methodologies.
- Document findings, optimize testing workflows, and contribute to continuous improvement of evaluation processes.

Advantages Our client offers a comprehensive benefits package designed to support your professional growth and well-being. This includes competitive salary packages, flexible remote working arrangements, and opportunities for career advancement within a global organization. You will have access to ongoing training and development programs, cutting-edge tools, and a collaborative work environment that fosters innovation. Additionally, employees benefit from health insurance plans, paid time off, and a supportive company culture that values diversity and inclusion.

Equal Opportunity

We are an equal opportunity employer committed to creating an inclusive environment for all employees. We hire based on skills, experience, and qualifications without discrimination based on race, gender, age, religion, national origin, disability, or any other protected characteristic. All qualified candidates are encouraged to apply, and we ensure a fair and transparent hiring process.

Our goal is to build a diverse team that reflects the communities we serve and fosters a culture of mutual respect and collaboration.

📌 Software Engineer (India)
🏢 FetchJobs.co
📍 India