Job Description
AI QA Automation Engineer - Immediate Joiners only (0-15 Days)
nBangalore / Pune / Mumbai
nExp Range - 5-8 years
nKey Responsibilities
nEval Framework & Quality Delivery
n
- n
- Design and build --- eval/golden-set regression framework for non-deterministic GenAI agent output, from scratch.n
- Partner with each AI Engineer to scope and build a golden-set test suite for every agent they ship, landing alongside the agent rather than after.n
- Define and track what "done" looks like for agent output quality, including golden-set pass rate and the rate of defects/false positives that escape to real users.n
- Extend and maintain general automated test coverage across the agents module - backend (xUnit) and frontend E2E (Playwirght) - where gaps exist alongside the eval work.n
- Flag where eval suite depth or scope needs to flex to keep pace with the delivery cadence, and work with the lead engineer to re-balance rather than let a quality backlog build up silently.n
- Beyond the agents module,



contribute to and help scale test automation practice across the wider --- platform - frontend E2E (Playwright) and backend (xUnit) - as the team's senior dedicated test engineer.n

n

nRequired Experience & Skills
n
- n
- 3-5+ years' experience in a software engineering or test automation role.n
- Experience designing test strategy from scratch, not just executing an existing suite.n
- Experience with C#/.NET testing (xUnit or similar) and/or JavaScript E2E testing frameworks (Playwright or similar).n
- Comfortable reading and reasoning about LLM/agent output well enough to write meaningful test assertions against it.n
- Ability to work independently across two engineers' agents in parallel, without becoming a bottleneck on their delivery cadence.n
- Experience working in a sprint-based development team.n

n

nDesirable / Nice-to-Have Skills
nExperience with some of the following is beneficial but not required:
n
- n
- Hands-on experience

📌 AI QA Test Engineer (Bengaluru)
🏢 Dentsu Global Services
📍 Bengaluru