Job Title: QA Engineer — AI Training Project (Human Data Evaluation)

Employment Type: Contract

Location: Remote

Workplace Type: Remote

Pay Range: $90 / hour

We are looking for experienced QA Engineers to contribute their expertise in software quality evaluation for a customer's high-volume project. In this role, you'll apply your QA expertise to help train next-generation AI systems — your work will directly shape how models learn, reason, and perform through high-quality, real-world input.

No prior experience in AI development is required — your domain knowledge is what matters most. However, this opportunity is open only to specialists who have both a solid QA background and prior paid experience with human data annotation, RLHF, model output evaluation, or rubric-based grading for AI training. Software QA experience alone, without a human-in-the-loop AI evaluation component, does not meet this requirement.

Scope of Work

Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics, identifying answers that may appear correct but are actually inaccurate or incomplete

Design and assess comprehensive test cases for functional, regression, and edge-case scenarios, including negative and boundary tests

Review bug reports and test documentation to ensure issues are reproducible, documentation is complete, and severity is properly assessed

Identify, isolate, and document defects with precise reproduction steps using structured tracking mechanisms

Provide detailed, actionable written feedback and annotations to support efficient resolution by developers without the need for clarification





Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards and methodologies

Qualifications

Proven professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or similar role in software quality assurance

Strong command of QA fundamentals, including test case design, bug tracking, regression testing, and both manual and automated testing strategies

Hands-on experience with automation frameworks and test management tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, or BrowserStack (or similar tools)

Prior human data experience supporting AI training — such as annotation, labeling, RLHF, AI response evaluation, model evaluation, or rubric-based grading — is a firm project requirement

Excellent analytical and problem-solving skills with meticulous attention to detail

Ability to communicate complex findings clearly in written English, with specific, actionable feedback (B2 level or above)

No formal degree required — practical, demonstrable testing experience takes precedence

Reliable internet connection and readiness to begin promptly

Compensation & Engagement

$90/hour, based on experience and task complexity

Contract, remote engagement

Compensation tied to quality and successful completion of assigned work

Ideal Candidate

You are a detail-oriented QA professional who combines deep software testing expertise with hands-on experience evaluating AI-generated outputs. You know how to spot subtle inaccuracies others might miss, write feedback developers can act on without follow-up questions, and thrive working independently on structured, rubric-driven evaluation work.

📌 QA Engineer - Ai Training Project (India)
🏢 Kaliper
📍 India