Job Type: Full-time

Role: Sr. AI QA EngineerLocation: Noida / Gurugram / Pune / MumbaiEmployment Type: Full-TimeAbout the RoleWe are looking for a highly skilled AI QA Engineer to join our Quality Engineering team. This role combines traditional automation testing expertise with modern AI application validation. The ideal candidate will have hands-on experience testing GenAI applications, LLM-powered systems, chatbots, RAG applications, and AI-driven workflows, along with strong automation experience using Playwright.You will work closely with Product, Engineering, Data Science, and AI teams to ensure the quality, reliability, and accuracy of next-generation AI-powered products.Key ResponsibilitiesDesign, develop, and maintain test automation frameworks using Playwright and Selenium.Perform end-to-end testing of web applications and AI-powered user experiences.Validate chatbot conversations, AI-generated responses, and conversational workflows.Execute testing for GenAI, LLM, and RAG (Retrieval-Augmented Generation) applications.Perform prompt testing, grounding validation, and hallucination detection.Validate AI agent workflows, multi-step reasoning, and tool integrations.Execute functional, regression, integration, API, database, and UAT testing.Perform SQL-based backend validations and data quality checks.Collaborate with cross-functional teams to define and implement quality strategies.Participate in Agile ceremonies and contribute to continuous quality improvement.Must-Have QualificationsBachelor's degree in Engineering (B.E./B.Tech) in Computer Science, Information Technology, Electronics,



or related fields.Strong hands-on experience with Playwright (Mandatory).Experience with Selenium Automation.Experience testing GenAI, LLM, Chatbot, or AI-powered applications.Hands-on experience with RAG Testing.Strong understanding of:Prompt TestingHallucination TestingResponse ValidationGrounding ValidationExperience with API Testing using Postman or REST APIs.Strong SQL skills and experience with databases such as:MySQLPostgreSQLMongoDBDynamoDBExperience with Python or Java.Familiarity with:GitJiraCI/CD PipelinesAgile MethodologiesGood-to-HaveExperience with Agentic AI TestingExperience with MCP (Model Context Protocol)Exposure to LangSmith, Ragas, Promptfoo, DeepEvalExperience with vector databases:PineconeChromaDBWeaviateFAISSAWS or GCP experienceExposure to Amazon Bedrock or Azure OpenAIPreferred Project ExperienceCandidates with experience in any of the following will be highly preferred:GenAI & Chatbot TestingConversational AI testingPrompt validationLLM response evaluationHallucination detectionRAG Application TestingRetrieval quality validationEmbedding and chunking validationKnowledge grounding verificationCitation accuracy testingAgentic AI TestingMulti-agent workflowsAutonomous decision-making systemsAI workflow orchestrationTool and API integrationsSkillsPlaywright, Selenium, Generative AI, LLM Testing, RAG Testing, AI Testing, Chatbot Testing, Prompt Testing, Agentic AI, Python, Java, API Testing, Postman, SQL, AWS, CI/CD, Jira, Test Automation, Quality AssuranceWhy Join Us?Join a team building creative AI-powered products where you'll play a critical role in ensuring reliability, accuracy, and exceptional user experiences through advanced AI quality engineering practices.

📌 Senior AI QA Engineer (Ghaziabad)
🏢 Biz2X
📍 Ghaziabad