Key Skills: LLM, Playwright Automation, Api Testing, Evaluation, Gen AI, Automation Testing, AI Agents, Python, Typescript, Postman, Retrieval-Augmented Generation (RAG)

Roles and Responsibilities:

- Design and execute test strategies for AI/GenAI applications, including LLM-based workflows, conversational systems, and AI agents.
- Build and maintain Playwright automation coverage for UI and end-to-end application flows.
- Develop API test cases and validate authentication, authorization, contracts, and error handling.
- Define evaluation checks for AI output quality, including relevance, groundedness, consistency, and hallucination detection.
- Partner with engineering and product teams to identify quality risks early and support release readiness decisions.

Skills Required:

- 4 to 7 years of experience in Quality Engineering, Software Testing,



or Test Automation.
- Hands-on experience in AI/GenAI testing, LLM validation, and quality evaluation.
- Solid Playwright automation experience with practical test framework development.
- Experience in API testing and automation for web and service-based applications.
- Ability to design scalable test coverage and quality gates for AI-enabled systems.

Good to Have:
- Python or TypeScript for automation.
- Postman, RAG, and AI agents.
- Exposure to Azure OpenAI, OpenAI, Claude, Gemini, and AI evaluation frameworks.

Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

📌 QA Test Consultant-AI (Bengaluru)
🏢 MyCareernet
📍 Bengaluru