About The Company

Quik Hire Staffing is a leading recruitment agency dedicated to connecting top talent with innovative organizations across various industries. With a commitment to excellence and a deep understanding of market trends, we strive to provide our clients with highly qualified professionals who can drive their business forward. Our extensive network and personalized approach ensure that both clients and candidates find the perfect match, fostering long-term success and growth.

About The Role

We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client's dynamic team on a full-time, remote basis. This role focuses on evaluating and validating large language models (LLMs) and building robust repositories for software engineering datasets. The ideal candidate will have a strong background in Ruby development, experience working with complex codebases, and a passion for advancing AI-driven software solutions. You will play a crucial role in developing evaluation frameworks that address real-world software engineering challenges, leveraging open-source repositories and innovative synthetic methodologies.

Qualifications

The successful candidate will possess a minimum of three years of professional experience in software engineering, with demonstrated expertise in Ruby and Ruby on Rails. Proficiency with version control systems such as Git, containerization tools like Docker, and experience setting up reproducible testing environments are essential. Candidates should have a solid understanding of Ruby testing frameworks such as RSpec or Minitest, as well as gem management using Bundler. Experience navigating and modifying complex codebases, along with prior contributions to open-source projects, will be considered advantageous. Strong analytical and problem-solving skills, coupled with excellent communication abilities, are key to thriving in this role.

Responsibilities





- Analyze and triage GitHub issues across trending open-source libraries to identify suitable evaluation scenarios for LLM testing.
- Set up and configure code repositories, including containerizing environments with Docker to ensure reproducibility and consistency during testing.
- Assess unit test coverage and analyze code quality metrics to establish baseline health and robustness of software projects.
- Modify, run, and debug Ruby codebases locally to evaluate the performance of language models in bug fixing, code completion, and other software engineering tasks.
- Collaborate closely with AI researchers and data scientists to design repositories and select challenging issues that effectively test LLM capabilities across multiple programming languages and difficulty levels.
- Document testing procedures, results, and insights to facilitate continuous improvement of evaluation methodologies and datasets.

Benefits

Joining our client offers an opportunity to be at the forefront of AI research and development, working on impactful projects that shape the future of software engineering. Employees will enjoy a flexible remote work environment, competitive compensation packages, and access to professional development resources. The role also provides exposure to cutting-edge AI technologies and collaboration with a global team of experts. Additional benefits include health insurance options, paid time off, and opportunities for career growth within a forward-thinking organization committed to innovation and excellence.

Equal Opportunity

Quik Hire Staffing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive workplace for all employees. We do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic. All qualified candidates will be considered based on their skills, experience, and qualifications. We encourage individuals from all backgrounds to apply and join our community of talented professionals.

📌 Software Engineer (India)
🏢 FetchJobs.co
📍 India