21 Aug
|
QualiZeal
|
Hyderabad
21 Aug
QualiZeal
Hyderabad
Role Overview
We are seeking an experienced
AI Test Lead
to lead end-to-end testing and quality assurance of Generative AI applications. This role bridges AI quality engineering, test automation, and customer engagement. You will collaborate with
QA Managers, AI/ML Engineers, Prompt Engineers, Full Stack Developers, and DevOps Engineers
to validate production-ready, scalable AI applications against industry AI testing standards, while serving as the primary testing point of contact for customers.
Key Responsibilities
AI Testing Strategy & Delivery Management
- Lead full lifecycle of AI testing activities: test strategy, planning, design, execution, defect management, and sign-off for GenAI applications
- Define and implement test strategies for LLM-powered applications including RAG systems, conversational AI, and AI agents
- Plan and manage functional, non-functional, and AI-specific testing: model evaluation, prompt regression, bias/fairness, robustness, hallucination detection, and explainability validation
- Establish test estimation, sprint-level test planning, milestones,
and delivery timelines aligned with agile development cycles
- Track and report test coverage, quality metrics, and release readiness to QA leadership and stakeholders
Customer Engagement & Test Management
- Act as the primary testing point of contact for customers; lead requirement discussions, status reviews, and defect triage calls
- Translate customer business requirements and acceptance criteria into comprehensive AI test plans and test scenarios
- Manage day-to-day testing activities of the QA team: task allocation, progress monitoring, risk identification, and escalation management
- Present test results, quality dashboards, and risk assessments to customer stakeholders in business-focused language
- Drive UAT support, release sign-off, and post-release quality monitoring in coordination with customer teams
AI Testing Standards & Quality Governance
- Implement AI testing practices
📌 Test Team Lead (Hyderabad)
🏢 QualiZeal
📍 Hyderabad