- Role : Software Engineer C# (Remote)
- Location : Remote (Work from Anywhere)

Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – C#(LLM Evaluation & Repository Validation) to work on a Full-Time basis. The project builds evaluation and training datasets for large language models by creating verifiable software engineering tasks from public repository histories using a synthetic approach with human‑in‑the‑loop. The work expands dataset coverage across programming languages, difficulty levels, and real‑world code scenarios.

Key Responsibilities:

- Analyze and triage GitHub issues across trending open‑source libraries to identify challenging cases for LLM assessment.
- Set up and configure code repositories, including Docker containerization and environment provisioning for reproducible testing.
- Evaluate unit test coverage and quality, documenting gaps and improvement opportunities.
- Modify and run codebases locally to measure LLM performance in bug‑fixing and code‑generation scenarios.
- Collaborate with AI researchers to design task sets and select repositories that stress test LLM capabilities.
- Lead and mentor junior engineers, coordinating their contributions to repository validation efforts.

Required Skills & Qualifications:





- Minimum three years of professional software development experience with strong proficiency in C#.
- Demonstrated expertise with Git version control, Docker, and basic software pipeline setup.
- Ability to navigate and understand complex codebases, and to run, modify, and test real‑world projects locally.
- Experience analyzing test coverage, writing unit tests, and assessing code quality.
- Prior involvement in open‑source contributions or evaluation projects is considered a plus.

More About the Opportunity:

This role offers a unique chance to work with a global leader in the artificial intelligence industry, contributing to the creation of realistic software engineering datasets that shape future AI‑assisted development tools. The position is fully remote, allowing collaboration with researchers and engineers worldwide while focusing on cutting‑edge AI research.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.

Apply Now!

📌 Software Engineer C# (Remote) (India)
🏢 Quik Hire Staffing
📍 India