02 Oct
|
taskverse
|
India
- Software Engineer – Ruby (Remote)About The Company
Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. With a strong focus on technology and software development sectors, we strive to facilitate meaningful employment opportunities that foster growth, creativity, and excellence. Our commitment to understanding both client needs and candidate aspirations ensures that we deliver tailored staffing solutions that align with organizational goals and individual career ambitions.
We pride ourselves on maintaining a transparent, efficient, and professional approach to recruitment, helping talent and companies thrive in a competitive market.
About The Role
We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client's dynamic team on a full-time basis. This remote role offers the flexibility to work from anywhere, providing an excellent opportunity to contribute to cutting-edge projects in the artificial intelligence domain. The primary focus of this position is on building and enhancing large language model (LLM) evaluation frameworks and repository validation tools.
You will be instrumental in developing datasets that simulate real-world software engineering challenges, utilizing innovative synthetic methods and human-in-the-loop approaches to generate verifiable and diverse tasks across multiple programming languages and difficulty levels.
The ideal candidate will possess a robust background in Ruby development, with experience in analyzing open-source repositories, setting up reproducible testing environments,
and collaborating with AI researchers to advance LLM capabilities. Your work will directly impact the development of AI-powered software development tools and benchmarks, shaping the future of intelligent coding assistance and evaluation standards.
Qualifications
- Minimum of three years of professional experience in software engineering, with a strong proficiency in Ruby and Ruby on Rails.
- Hands-on experience with version control systems such as Git, containerization tools like Docker, and setting up software pipelines for reproducible testing.
- Ability to understand and navigate complex, real-world codebases, including running, modifying, and testing code locally.
- Familiarity with Ruby testing frameworks such as RSpec and Minitest, as well as gem management with Bundler and code quality tools.
- Experience contributing to or evaluating open-source projects is considered a plus.
Responsibilities
- Analyze and triage issues reported on GitHub across trending open-source libraries to identify suitable evaluation scenarios for LLM testing.
- Set up and configure code repositories, including creating Docker containers and preparing environments to ensure reproducibility of tests and experiments.
- Assess code health by evaluating unit test coverage and quality metrics,
ensuring robustness and reliability of codebases used for evaluation.
- Modify, run, and debug Ruby codebases locally to measure the performance of language models in bug fixing, code completion, and related tasks.
- Collaborate closely with AI research teams to design and select repositories and issues that present challenging and meaningful cases for LLM evaluation, contributing to the development of comprehensive benchmarking datasets.
Benefits Joining our client offers a unique opportunity to work at the forefront of artificial intelligence research and development. The role provides competitive compensation packages, flexible remote working arrangements, and the chance to collaborate with a global team of experts in AI and software engineering. Employees benefit from continuous learning and professional growth opportunities, exposure to innovative projects, and the ability to influence the future of AI-assisted software development tools. Additionally, the organization promotes a healthy work-life balance, inclusive culture, and recognition of individual contributions.
Equal Opportunity Employer
We are committed to fostering an inclusive environment where all qualified candidates are encouraged to apply.
Quik Hire
Staffing hires based on skills, experience, and qualifications without regard to race, gender, age, ethnicity, sexual orientation, disability, or background. We believe diversity enriches our community and drives innovation. All applications are reviewed solely on demonstrated technical ability and suitability for the role.
Apply Now!
📌 Software Engineer (India)
🏢 taskverse
📍 India