About The Company

Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative companies across various industries. With a commitment to excellence and a focus on client satisfaction, Quik Hire Staffing specializes in sourcing top-tier talent for technology, engineering, and creative roles. Our extensive network and industry expertise enable us to deliver tailored staffing solutions that meet the unique needs of each client, fostering long-term partnerships and career growth opportunities for candidates.

About The Role

We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client’s dynamic team on a full-time, remote basis. This role focuses on evaluating and validating large language models (LLMs) and their ability to interact with real-world codebases. The ideal candidate will have a strong background in Ruby development, experience with open-source projects, and a keen interest in AI and software engineering challenges.

As a key contributor, you will be instrumental in building datasets and evaluation frameworks that push the boundaries of AI’s understanding of complex software tasks. Your work will directly influence the development of AI-powered tools aimed at improving software development workflows and benchmarks, making a significant impact on the future of AI-assisted programming.

Qualifications

- Minimum of three years professional experience in software engineering, with a strong proficiency in Ruby and Ruby on Rails.
- Demonstrated expertise in using Git for version control, Docker for environment management, and setting up reproducible software pipelines.
- Ability to navigate and understand complex, real-world codebases, including running, modifying, and testing code locally.
- Experience with Ruby testing frameworks such as RSpec and Minitest, as well as gem management using Bundler.
- Familiarity with code quality tools and practices to ensure maintainability and robustness of software.




- Prior contributions to or evaluations of open-source projects are highly desirable.

Responsibilities

- Analyze and triage issues from trending open-source repositories on platforms like GitHub to identify suitable evaluation scenarios for LLMs.
- Set up and configure code repositories, including containerization with Docker and environment preparation for reproducible testing workflows.
- Assess code health by evaluating unit test coverage and quality metrics to ensure robustness and reliability of the codebase.
- Modify, run, and test Ruby codebases locally to measure the performance of LLMs in bug fixing and code completion tasks.
- Collaborate closely with AI researchers to design and select repositories and issues that present challenging cases for language models, contributing to dataset creation and evaluation strategies.
- Document findings, develop testing protocols, and contribute to continuous improvement of evaluation methodologies.

Benefits Our client offers a comprehensive benefits package designed to support your professional and personal growth. Employees enjoy competitive salary packages, flexible work arrangements, and opportunities for continuous learning and development. You will be part of an creative environment that encourages creativity and collaboration, with access to cutting-edge tools and technologies. Additionally, remote work flexibility allows you to maintain a healthy work-life balance, and you will be supported by a team of passionate professionals dedicated to making a difference in the AI and software engineering landscape.

Equal Opportunity

Quik Hire Staffing and our clients are committed to fostering an inclusive and diverse workplace. We hire based on merit and skills, without regard to race, gender, ethnicity, religion, age, sexual orientation, disability, or any other protected characteristic. All qualified candidates are encouraged to apply, and we ensure that the hiring process is unbiased and equitable.

We believe that diverse perspectives drive innovation and excellence, and we welcome applicants from all backgrounds to join our team.

📌 Software Engineer (India)
🏢 FetchJobs.co
📍 India