About The Company Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. With a focus on excellence and a commitment to understanding client needs, Quik Hire Staffing strives to facilitate meaningful employment opportunities that align with candidates' skills and career aspirations.

Our extensive network and industry expertise enable us to match top-tier talent with forward-thinking companies, fostering growth and success for all stakeholders involved.

About The Role We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client's dynamic team on a full-time basis. This remote position offers the flexibility to work from anywhere, making it an ideal opportunity for professionals who thrive in a virtual environment.

The role centers around evaluating and enhancing large language models (LLMs) by developing robust datasets and testing frameworks that simulate real-world software engineering challenges. The successful candidate will play a crucial role in building and validating datasets derived from public repositories, employing synthetic methods combined with human-in-the-loop techniques to ensure accuracy and coverage across multiple programming languages and difficulty levels.

Qualifications

- Minimum of three years of professional experience in software engineering, with a strong proficiency in Ruby and Ruby on Rails.
- Solid understanding of Git version control, Docker containerization, and setting up reproducible software pipelines.
- Experience navigating and modifying complex, real-world codebases, with the ability to run and test code locally.
- Familiarity with Ruby testing frameworks such as RSpec and Minitest, as well as gem management tools like Bundler.
- Knowledge of code quality tools and practices to ensure maintainability and robustness of software.
- Prior involvement in open-source projects, either through contributions or evaluations, is considered an advantage.





Responsibilities The Software Engineer will be responsible for a variety of tasks integral to the development and evaluation of AI models related to software engineering:

- Analyze and triage issues from trending open-source repositories on platforms like GitHub to identify suitable evaluation scenarios for LLMs.
- Set up and configure code repositories, including creating Docker containers and preparing environments to ensure reproducibility of tests and experiments.
- Assess unit test coverage and quality metrics to establish baseline code health and evaluate the robustness of test suites.
- Modify and execute Ruby codebases locally to measure the performance of language models in bug fixing and code completion tasks.
- Collaborate closely with AI researchers to design, select, and curate repositories and issues that present challenging cases for LLM evaluation.
- Document findings, contribute to the development of datasets, and refine testing methodologies to improve model performance assessments.

Benefits This role offers a competitive compensation package aligned with industry standards, along with comprehensive perks designed to support your professional and personal well-being. Employees enjoy versatile working hours, the ability to work remotely from anywhere in the world, and opportunities for continuous learning and development. Our client fosters a collaborative and innovative work environment that encourages growth, creativity, and the pursuit of excellence. Additional benefits include health insurance options, paid time off, and access to cutting-edge tools and resources to facilitate your success in this role.

Equal Opportunity

Quik Hire Staffing and our clients are committed to fostering an inclusive and diverse workplace. We hire based on merit and skills, and all qualified candidates are encouraged to apply regardless of race, gender, age, religion, national origin, sexual orientation, disability, or any other characteristic protected by law. We believe that diverse teams drive innovation and excellence, and we are dedicated to providing equal employment opportunities to all applicants.

Apply Now!

📌 Software Engineer (India)
🏢 FetchJobs.co
📍 India