Job Summary

Senior Manager

Senior Manager stronger Python, automation, agentic AI

Responsibilities

- Own the end-to-end test strategy, test plans, acceptance-criteria coverage, and release-quality evidence for the Agentic product.
- Build and maintain automated regression and integration tests using UHG provided tools such as Playwright, Cypress, Selenium, API testing frameworks, and Python testing libraries.
- Validate agent behavior beyond conventional UI/API testing, including tool selection and sequencing, function-call inputs/outputs, orchestration paths, refusal/escalation behavior, and human-in-the-loop controls.
- Design and execute positive, negative, ambiguous, adversarial, and out-of-scope scenarios for every relevant acceptance criterion.
- Maintain evaluation datasets and regression suites for AI-generated outputs, with focus on correctness, consistency, factual grounding, and prevention of regressions when prompts, models,



configurations, or tools change.
- Validate agent execution logs and traceability across perception, reasoning, planning, execution, retries/corrections, and resulting outputs so test evidence can be reviewed by SMEs.
- Test security and access-control scenarios, including negative authorization cases and agent/tool boundaries, and coordinate with Security and Compliance SMEs on identified issues.
- Perform defect triage and root-cause analysis with developers, track defects through closure, and provide explicit quality and release-readiness reporting through automated scripts/dashboards where practical.
- Support performance and regression testing and contribute evidence required for system testing, UAT, and release gates.

📌 DE-NCLC-SM-Agenetic AI Professional (Bengaluru)
🏢 EY
📍 Bengaluru