The Prospect

As a QE AI Test Manager, you will lead a team of quality engineering professionals to define and execute testing strategies for AI models and systems, including Narrow AI, Generative AI, and Agentic AI.

You will be responsible for ensuring data quality, model validation, and overall testing governance across the AI lifecycle. The role also involves driving AI testing capabilities, managing stakeholders, planning resource requirements, and enabling best practices across engagements.

You will collaborate with global stakeholders and clients to deliver business outcomes while building scalable AI testing competency within the organization.

Your Key Responsibilities

- Define and drive end-to-end test strategy and governance for AI systems
- Lead and mentor QE teams delivering AI testing engagements
- Oversee data validation, model evaluation, anomaly detection, and statistical analysis
- Ensure AI systems meet functional, performance, ethical, and responsible AI requirements
- Establish metrics and KPIs to measure AI system effectiveness and quality




- Manage stakeholder communication across clients and internal teams
- Plan and forecast resource requirements for AI testing engagements
- Drive adoption of best practices, tools, and frameworks across AI testing delivery
- Identify risks in AI models and define mitigation strategies
- Prepare and present testing reports, risks, and progress updates to stakeholders
- Maintain documentation of testing processes, results, and learnings

Skills and attributes for success

- AI/ML concepts
- LLMs
- Agentic AI systems
- validation strategies for AI models and systems
- test automation tools (Selenium, Playwright, PyTest)
- Python programming
- GitHub Copilot or similar AI-assisted development tools
- cloud platforms (Azure, AWS, GCP)
- Agile environments

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Testing- AI Test Lead Manager (Karnataka)
🏢 EY
📍 Karnataka