The Prospect

As a QE AI Test Manager, you will lead a team of quality engineering specialists to define and execute testing strategies for AI models and systems, including Narrow AI, Generative AI, and Agentic AI.

You will be responsible for ensuring data quality, model validation, and overall testing governance across the AI lifecycle. The role also involves driving AI testing capabilities, managing stakeholders, planning resource requirements, and enabling best practices across engagements.

You will collaborate with global stakeholders and clients to deliver business outcomes while building scalable AI testing competency within the organization.

Your Key Responsibilities
Define and drive end-to-end test strategy and governance for AI systems
Lead and mentor QE teams delivering AI testing engagements
Oversee data validation, model evaluation, anomaly detection, and statistical analysis
Ensure AI systems meet functional, performance, ethical, and responsible AI requirements
Establish metrics and KPIs to measure AI system effectiveness and quality




Manage stakeholder communication across clients and internal teams
Plan and forecast resource requirements for AI testing engagements
Drive adoption of best practices, tools, and frameworks across AI testing delivery
Identify risks in AI models and define mitigation strategies
Prepare and present testing reports, risks, and progress updates to stakeholders
Maintain documentation of testing processes, results, and learnings

Skills and attributes for success
AI/ML concepts
LLMs
Agentic AI systems
validation strategies for AI models and systems
test automation tools (Selenium, Playwright, PyTest)
Python programming
GitHub Copilot or similar AI-assisted development tools
cloud platforms (Azure, AWS, GCP)
Agile environments

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Testing Ai Test Lead Manager Karnataka
🏢 EY
📍 Karnataka