About The Company

Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. With a commitment to excellence and a focus on understanding client needs, Quik Hire Staffing has built a reputation for delivering top-tier staffing solutions tailored to the evolving demands of the modern workforce. Our mission is to facilitate seamless employment opportunities by leveraging extensive industry networks and a thorough understanding of market trends, ensuring both clients and candidates achieve their goals efficiently and effectively.

About The Role

We are currently seeking a highly skilled Software Engineer specializing in Ruby to join our client's dynamic team on a full-time, remote basis. In this role, you will be instrumental in developing and evaluating large language models (LLMs) through creating datasets and evaluation scenarios that mirror real-world software engineering challenges. Your expertise will contribute to building verifiable tasks from public repository histories, employing synthetic methods with human-in-the-loop processes, and expanding coverage across various programming languages and difficulty levels.

This position offers an exciting opportunity to work at the forefront of AI research, focusing on enhancing LLM capabilities in understanding and generating complex codebases.

Qualifications The ideal candidate will possess a minimum of three years of professional experience in software engineering with a strong proficiency in Ruby and Ruby on Rails. Demonstrated expertise with version control systems such as Git, containerization tools like Docker, and experience setting up reproducible software pipelines are essential. Candidates should have a solid understanding of navigating and modifying complex, real-world codebases, with the ability to run and test code locally.

Familiarity with Ruby testing frameworks such as RSpec and Minitest,



as well as gem management using Bundler, is required.

Experience contributing to or evaluating open-source projects will be considered a plus, reflecting a proactive approach to team-oriented development and code quality assurance.

Responsibilities

- Analyze and triage GitHub issues across trending open-source libraries to identify suitable evaluation scenarios for LLM testing.
- Set up and configure code repositories, including creating Docker containers and preparing environments to ensure reproducible testing conditions.
- Assess unit test coverage and quality metrics to evaluate baseline code health and the robustness of test suites.
- Modify and run Ruby codebases locally to measure the performance of language models in bug fixing and code completion tasks.
- Collaborate closely with AI researchers to design, select, and refine repositories and issues that challenge LLM capabilities and improve evaluation metrics.

Benefits Joining our client's team offers numerous benefits, including the opportunity to work remotely from anywhere in the world, providing flexibility and work-life balance. You will be part of a cutting-edge AI research environment that fosters innovation and continuous learning. Competitive compensation packages, opportunities for professional development, and exposure to pioneering projects in artificial intelligence are integral parts of this role. Additionally, you will gain valuable experience working with a global leader in AI, contributing to impactful advancements in software engineering and machine learning domains.

Equal Opportunity

We are an equal opportunity employer committed to fostering an inclusive and diverse workplace. We hire based on skills, qualifications, and experience without regard to race, gender, age, religion, sexual orientation, disability, or any other protected characteristic. All qualified candidates are encouraged to apply, and our selection process is solely focused on demonstrated technical ability and suitability for the role.

Apply Now!

📌 Software Engineer (India)
🏢 taskverse
📍 India