Job Description:
Job Title: Quality Assurance Engineer – AI Agentic Applications
Location: Pune, India
Corporate Title: AVP

Role Description
Quality Assurance Engineer to validate AI agentic applications across development and production. The position combines specialized AI testing, automation, safety evaluation, and continuous quality measurement. The engineer is responsible to design, build and execute the test strategy for LLM accuracy, RAG ingestion and attribution, agent planning and tool use, recovery behavior, and production failure patterns

What we’ll offer you
As part of our flexible scheme, here are just some of the perks that you’ll enjoy
• Best in class leave policy
• Gender neutral parental leaves
• 100% reimbursement under childcare assistance benefit (gender neutral)
• Sponsorship for Industry relevant certifications and education
• Employee Assistance Program for you and your family members
• Comprehensive Hospitalization Insurance for you and your dependents
• Accident and Term life Insurance
• Complementary Health screening for 35 yrs.



and above

Your key responsibilities
• Design, execute, and maintain test strategies and automation frameworks for AI-powered agentic workflows
• Develop and implement specialized testing approaches for LLM-powered applications, validating response accuracy, relevance, and grounding, while identifying hallucinations and edge-case behaviours
• Test and evaluate the behaviour of autonomous and semi-autonomous AI agents, ensuring proper planning, tool selection/sequencing, agent-to-agent interactions, and graceful error/timeout recovery
• Validate Retrieval-Augmented Generation (RAG) performance, including document ingestion, chunking, metadata quality, embedding accuracy, and citation/source attribution
• Perform AI safety and security testing to identify vulnerabilities such as prompt injection (direct/indirect), data leakage, unauthorized tool execution, and privilege escalation
• Establish quantitative AI eval

📌 Quality Assurance Engineer – AI Agentic Applications, AVP (Pune)
🏢 Deutsche Bank
📍 Pune