Responsibilities

- Design and execute test plans specifically for AI/ML features and LLM-integrated product workflows
- Evaluate model outputs for accuracy, consistency, edge cases, hallucinations, and bias
- Build and maintain automated evaluation pipelines and regression benchmarks
- Run prompt testing, adversarial testing, and structured red-teaming exercises
- Define quality metrics and release criteria for AI-driven features

Requirements

- 2-4 years in software QA or SDET roles, with at least 1 year on AI/ML products
- Hands-on experience testing LLM-based features or AI APIs
- Proficiency in Python and testing frameworks (pytest, unittest)
- Familiarity with prompt engineering and evaluation techniques
- Experience with CI/CD pipelines and automated test infrastructure

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 AI QA Engineer (Mumbai)
🏢 TESTRIQ
📍 Mumbai