Test Manager AI Architect / Manager

Location : Bangalore

Experience : 10 to 15 years

Job Summary

The Test Manager – AI Architect / Manager is a senior leadership role responsible for defining, architecting, and driving the AIled Quality Engineering (QE) vision across the enterprise. This role owns AIdriven QA architecture, leads the design and deployment of AI bots, agents, and GenAI flows, and defines the endtoend AI strategy and roadmap for the ETMS practice.

The role requires a robust blend of handson AI architecture expertise, strategic leadership, and stakeholder communication, with the ability to productize intelligent automation and embed AIdriven quality governance across platforms.

Key Responsibilities:
Architect and own AIdriven QA platforms across enterprise programs, ensuring scalability, observability, and governance
Build, productize, and deploy AI Bots / AI Agents for testing, analytics, and quality decisioning
Define and drive the endtoend AI strategy and roadmap for the ETMS practice
Provide handson technical leadership in AI agents, GenAI architectures, and intelligent automation frameworks
Design enterprisewide LLM integration strategies across:
Test automation frameworks
Internal QA tools
Managed QA platforms
enabling intelligent automation,



AI observability, and quality governance
Establish AIdriven quality metrics and evaluation frameworks using ML metrics (precision, recall, F1, confusion matrix)
Lead evaluation, selection, onboarding, and governance of AI tools and platforms
Integrate AI solutions into CI/CD pipelines for predictive quality, analytics, and automation
Drive stakeholder communication and AI narrative building, translating complex AI capabilities into business value
Define data strategy and governance models for AIenabled QA solutions
Mentor and grow AI architects, test managers, and technical leaders within the practice

Qualifications and Skills:
Bachelor’s or master’s degree in computer science, Engineering, Data Science, or equivalent experience.
6+ years of experience in QA automation or software engineering.
3+ years of experience working with AIdriven automation or intelligent testing frameworks.
Minimum 2 years of handson experience in building or testing AIbased tools or platforms.

Must Have Tools
LangChain + LangSmith / LlamaIndex
DeepEval / RAGAS
MLflow / Comet ML
Scikitlearn metrics
Azure OpenAI / AWS Bedrock
AutoGen

📌 Artificial Intelligence Architect Bengaluru
🏢 PwC
📍 Bengaluru