? Urgent Hiring | QA Engineer – AI Training Project

Role: QA Engineer

Experience: 7+ Years

Employment Type: Contract

Work Mode: Remote

Shift: Flexible 8-hour shift (Must be available for meetings during EST hours)

Interview Process: AI-based interview

We are urgently looking for an experienced QA Engineer to support an AI training project for a forward-thinking customer. The ideal candidate should have strong software quality assurance expertise, excellent English communication skills, and mandatory hands-on experience in data labeling, data annotation, Reinforcement Learning from Human Feedback (RLHF), or AI model evaluation.

In this role, you will contribute to improving the quality, accuracy, and reliability of next-generation AI systems through structured testing, data evaluation, annotation, and detailed documentation.

Key Responsibilities

- Design, execute, and document test cases and test scenarios to validate AI-generated outputs against defined requirements.
- Perform data labeling and annotation to improve the quality and accuracy of AI/ML training datasets.
- Evaluate AI model outputs, predictions, and responses to identify errors, inconsistencies, and quality issues.
- Analyze results and report defects with clear documentation and actionable feedback.
- Contribute to AI model evaluation, response quality assessment, and RLHF-related activities.
- Maintain accurate records of test execution, evaluation results,



and quality metrics.
- Collaborate with cross-functional teams to clarify requirements, communicate findings, and recommend improvements.
- Support the development and refinement of quality assurance methodologies for AI-driven systems.

Required Skills
- 7+ years of experience in Software Quality Assurance (QA).
- Mandatory hands-on experience in at least one of the following:
- Data Labeling
- Data Annotation
- Reinforcement Learning from Human Feedback (RLHF)
- AI Model Evaluation
- Strong knowledge of test case design, test execution, defect reporting, and test documentation.
- Experience evaluating data quality, model responses, or AI-generated outputs.
- Excellent English communication skills (B2 level or above).
- Strong analytical thinking, attention to detail, and problem-solving abilities.
- Ability to work independently and collaborate effectively with cross-functional teams.
- Must have an active LinkedIn profile.
- Must be available for meetings during EST hours and complete an 8-hour workday.

Preferred Qualifications
- Experience working on AI/ML training, evaluation, or data quality projects.
- Familiarity with human feedback-based model improvement and AI response evaluation.
- Experience identifying patterns, inconsistencies, and quality issues in large datasets.
- Solid written communication and reporting skills.

📌 Senior QA Engineer (7+ yrs) (India)
🏢 MindBrain
📍 India