? Urgent Hiring | QA Engineer – AI Training Project

Role: QA Engineer

Experience: 7+ Years

Employment Type: Contract

Work Mode: Remote

Shift: Flexible 8-hour shift (Must be available for meetings during EST hours)

Interview Process: AI-based interview

We are urgently looking for an experienced QA Engineer to support an AI training project for a forward-thinking customer. The ideal candidate should have strong software quality assurance expertise, excellent English communication skills, and mandatory hands-on experience in data labeling, data annotation, Reinforcement Learning from Human Feedback (RLHF), or AI model evaluation .

In this role, you will contribute to improving the quality, accuracy, and reliability of next-generation AI systems through structured testing, data evaluation, annotation, and detailed documentation.

Key Responsibilities

- Design, execute, and document test cases and test scenarios to validate AI-generated outputs against defined requirements.
- Perform data labeling and annotation to improve the quality and accuracy of AI/ML training datasets.
- Evaluate AI model outputs, predictions, and responses to identify errors, inconsistencies, and quality issues.
- Analyze results and report defects with clear documentation and actionable feedback.
- Contribute to AI model evaluation, response quality assessment, and RLHF-related activities.
- Maintain accurate records of test execution, evaluation results,



and quality metrics.
- Collaborate with cross-functional teams to clarify requirements, communicate findings, and recommend improvements.
- Support the development and refinement of quality assurance methodologies for AI-driven systems.

Required Skills
- 7+ years of experience in Software Quality Assurance (QA).
- Mandatory hands-on experience in at least one of the following:
- Data Labeling
- Data Annotation
- Reinforcement Learning from Human Feedback (RLHF)
- AI Model Evaluation
- Solid knowledge of test case design, test execution, defect reporting, and test documentation.
- Experience evaluating data quality, model responses, or AI-generated outputs.
- Excellent English communication skills (B2 level or above).
- Strong analytical thinking, attention to detail, and problem-solving abilities.
- Ability to work independently and collaborate effectively with cross-functional teams.
- Must have an active LinkedIn profile.
- Must be available for meetings during EST hours and complete an 8-hour workday.

Preferred Qualifications
- Experience working on AI/ML training, evaluation, or data quality projects.
- Familiarity with human feedback-based model improvement and AI response evaluation.
- Experience identifying patterns, inconsistencies, and quality issues in large datasets.
- Strong written communication and reporting skills.

📌 Senior QA Engineer (7+ yrs) (India)
🏢 MindBrain
📍 India