About The Company

Quik Hire Staffing is a reputable recruitment agency dedicated to connecting talented professionals with leading organizations across various industries. With a focus on excellence and integrity, we strive to provide our clients with top-tier talent and offer candidates opportunities to advance their careers. Our commitment to understanding the unique needs of both employers and job seekers ensures a seamless hiring experience, fostering long-term success and growth for all parties involved.

About The Role

We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client's innovative team on a full-time, remote basis. This role focuses on evaluating and validating large language models (LLMs) by building robust datasets that simulate real-world software engineering challenges. The ideal candidate will have a strong background in Ruby development, with experience in analyzing complex codebases, setting up reproducible environments, and collaborating with AI research teams.

You will play a pivotal role in advancing AI-driven software development tools by creating verifiable tasks from open-source repositories, leveraging synthetic methods, and expanding coverage across various programming languages and difficulty levels.

Qualifications

- Minimum of three years of skilled experience in software engineering, with a strong proficiency in Ruby and Ruby on Rails.
- Hands-on experience with Git for version control, Docker for containerization, and setting up software pipelines for reproducible testing environments.
- Proficiency in navigating, understanding, and modifying complex, real-world codebases locally.
- Experience with Ruby testing frameworks such as RSpec and Minitest, as well as gem management using Bundler.
- Knowledge of code quality tools and best practices for maintaining high standards in software development.
- Prior contributions to open-source projects or experience evaluating open-source repositories is a plus.





Responsibilities

- Analyze and triage issues on GitHub across trending open-source libraries to identify suitable evaluation scenarios for LLMs.
- Set up and configure code repositories, including creating Docker containers and preparing environments for consistent, reproducible testing.
- Evaluate unit test coverage and quality metrics to assess the baseline health of codebases and the robustness of test suites.
- Modify, run, and test Ruby codebases locally to measure the performance of LLMs in bug fixing and code completion tasks.
- Collaborate closely with AI researchers to design and select repositories and issues that present challenging cases for language models, ensuring diverse and comprehensive evaluation datasets.
- Continuously improve evaluation methodologies by incorporating new open-source projects and refining synthetic task creation processes.

Benefits Joining this role offers a unique opportunity to work at the forefront of artificial intelligence research and development. You will be part of a collaborative environment that values innovation, continuous learning, and professional growth. The position provides competitive compensation, flexible work arrangements, and access to cutting-edge tools and resources. Additionally, you will have the chance to contribute to impactful projects that shape the future of AI-assisted software engineering, gaining valuable experience and expanding your expertise in a rapidly evolving field.

Equal Opportunity

Quik Hire Staffing is an equal opportunity employer. We believe in fostering a diverse and inclusive work environment where all qualified candidates are treated with respect and fairness. We do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic.

Our hiring decisions are based solely on skills, qualifications, and the ability to contribute to our clients’ success. We encourage individuals from all backgrounds to apply and look forward to welcoming talented professionals to our team.

📌 Software Engineer (India)
🏢 taskverse
📍 India