Senior Quality Engineer role focused on traditional test automation and AI/GenAI quality assurance. The position emphasizes validating LLM outputs, RAG pipelines, and production-ready AI systems while embedding quality across Agile delivery.
Role: Senior Quality Engineer
Experience
6 to 10 years of experience
8-10 years of experience in quality engineering
Proven hands-on experience testing LLM-powered applications and RAG pipelines
Strong test automation expertise with Selenium, Playwright, or equivalent
Solid API testing skills for REST, GraphQL, and gRPC
Hands-on experience with LLM evaluation frameworks
Advanced Python skills
Strong CI/CD integration experience
Experience testing cloud-native and microservices architectures
Deep understanding of shift-left quality practices
Excellent communication skills
Qualification
ISTQB Advanced Level Test Automation Engineer or Test Manager certification
ISTQB CT-AI Certified Tester AI Testing certification
AWS, Azure, or GCP cloud fundamentals or associate-level certification
Responsibilities
Design and implement testing strategies for GenAI applications
Cover LLM output validation, RAG pipeline testing, prompt regression, hallucination detection, and responsible AI evaluation
Build and maintain LLM evaluation frameworks and define metrics for relevance, faithfulness, precision, and recall
Design prompt testing frameworks and validate prompt behavior across model versions
Conduct adversarial testing and red-teaming for jailbreaks, prompt injection, bias, and safety bypasses
Validate AI guardrails and safety filters
Test for model dri
📌 Senior Quality Engineer (Gurugram)
🏢 Top Gen AI Jobs
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.