About The Company

Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with creative organizations across various industries. With a focus on quality and efficiency, Quik Hire Staffing prides itself on understanding the unique needs of both clients and candidates to facilitate successful employment relationships. Our commitment to excellence ensures that we provide tailored staffing solutions that align with organizational goals and individual career aspirations.

We leverage a vast network, industry expertise, and a thorough screening process to deliver top-tier talent for temporary, permanent, and contract roles globally.

About The Role

We are currently seeking a highly skilled Software Engineer specializing in Ruby to join our client's dynamic team on a full-time, remote basis. This role offers an exciting opportunity to work at the forefront of artificial intelligence research, specifically focusing on Large Language Model (LLM) evaluation and repository validation. The ideal candidate will be instrumental in developing datasets and evaluation frameworks that simulate real-world software engineering challenges.

Your work will involve analyzing open-source repositories, setting up reproducible testing environments, and collaborating with AI researchers to enhance LLM performance in understanding and fixing complex codebases. This position is perfect for someone passionate about software engineering, AI, and open-source contributions, seeking to make a tangible impact on the future of AI-assisted development tools.





Qualifications The successful candidate will possess a minimum of three years of professional experience in software engineering with a strong proficiency in Ruby and Ruby on Rails. You should have demonstrated expertise in using Git for version control, Docker for containerization, and setting up software pipelines for reproducible testing environments. A deep understanding of complex, real-world codebases is essential, along with the ability to run, modify, and test code locally.

Familiarity with Ruby testing frameworks such as RSpec and Minitest, as well as gem management tools like Bundler, is required.

Experience contributing to or evaluating open-source projects will be considered a significant advantage. Candidates must have excellent problem-solving skills, attention to detail, and the ability to collaborate effectively with multidisciplinary teams.

Responsibilities

- Analyze and triage GitHub issues across trending open-source libraries to identify suitable evaluation scenarios that can challenge and benchmark LLMs effectively.
- Set up and configure code repositories, including containerization using Docker, to create reproducible testing environments for evaluation and development.
- Assess unit test coverage and code quality metrics to establish baseline health and robustness of software repositories.
- Modify, run, and debug Ruby codebases locally to evaluate LLM performance in bug fixing, code completion,



and other code understanding tasks.
- Collaborate closely with AI research teams to design datasets and select repositories that present complex, realistic challenges for language models.
- Document findings, contribute to the development of evaluation frameworks, and continuously improve testing methodologies.

Benefits Joining our client’s team offers numerous benefits, including the flexibility of remote work, allowing you to work from anywhere. You will have the opportunity to contribute to cutting-edge AI research and development, impacting the future of software engineering tools. The role provides competitive salary packages, professional development opportunities, and a collaborative work environment that fosters innovation. Additionally, you will gain exposure to a global network of AI professionals and participate in projects that push the boundaries of current technology. Our client values work-life balance and offers flexible working hours, along with comprehensive health benefits and support for continuous learning and growth.

Equal Opportunity Employer

We are committed to fostering an inclusive environment where all individuals are treated with respect and dignity.

Quik Hire

Staffing and our clients hire based on skills, qualifications, and experience, without regard to race, gender, age, religion, sexual orientation, disability, or any other protected characteristic. We believe diversity enhances innovation and are dedicated to providing equal employment opportunities to all candidates. All applicants will be considered solely on their demonstrated abilities and suitability for the role.

📌 Software Engineer (India)
🏢 FetchJobs.co
📍 India