Role: Sr. AI QA Engineer
Location: Noida / Gurugram / Pune / Mumbai
Employment Type: Full time
About the Role
We are looking for a highly skilled
AI QA Engineer
to join our Quality Engineering team. This role combines traditional automation testing expertise with modern AI application validation. The ideal candidate will have hands-on experience testing
GenAI applications, LLM-powered systems, chatbots, RAG applications, and AI-driven workflows
, along with strong automation experience using
Playwright
.
You will work closely with Product, Engineering, Data Science, and AI teams to ensure the quality, reliability, and accuracy of next-generation AI-powered products.
Key Responsibilities
Design, develop, and maintain test automation frameworks using
Playwright
and Selenium.
Perform end-to-end testing of web applications and AI-powered user experiences.
Validate chatbot conversations, AI-generated responses, and conversational workflows.
Execute testing for
GenAI, LLM, and RAG (Retrieval-Augmented Generation)
applications.
Perform prompt testing,
grounding validation, and hallucination detection.
Validate AI agent workflows, multi-step reasoning, and tool integrations.
Execute functional, regression, integration, API, database, and UAT testing.
Perform SQL-based backend validations and data quality checks.
Collaborate with cross-functional teams to define and implement quality strategies.
Participate in Agile ceremonies and contribute to continuous quality improvement.
Must-Have Qualifications
Bachelor's degree in Engineering (
B.E./B.Tech
) in Computer Science, Information Technology, Electronics, or related fields.
Solid hands-on experience with
Playwright
(Mandatory).
Experience with
Selenium Automation
.
Experience testing
GenAI, LLM, Chatbot, or AI-powered applications
.
Hands-on experience with
RAG Testing
.
Solid understanding of:
Prompt Testing
Hallucination Testing
Response Validation
Grounding Validation
Exp
📌 Senior Ai Qa Engineer Noida (India)
🏢 Biz2X
📍 India