14 Sep
|
Tekion
|
Karnataka
Role Overview
We are looking for an experienced QA Manager to lead our quality engineering function, with a solid focus on test automation, evaluation of AI/LLM-based systems, and team leadership. The ideal candidate combines deep hands-on technical expertise with proven experience managing and mentoring QA teams.
Key Details
Position: QA Manager – Automation
Total Experience: 10 to 17 years
Team Management Experience: Minimum 2 years (leading QA/automation teams)
Employment Type: Full-time
Roles & Responsibilities
Lead, mentor, and grow a team of QA/automation engineers, driving their technical and career development.
Define and own the overall test automation strategy, framework architecture, and quality roadmap for the product.
Design, build, and maintain scalable automation frameworks using Playwright for web application testing.
Drive evaluation (eval) strategies for AI/LLM-based features — designing test harnesses, golden datasets, scoring rubrics, and regression suites for model outputs.
Partner with data science/ML engineering teams to define quality benchmarks for LLM-powered and AI-driven systems, including hallucination checks, output consistency, and prompt regression testing.
Write and review robust, maintainable automation code in Java, integrating with CI/CD pipelines.
Establish QA processes, best practices, and metrics (coverage, defect leakage, automation ROI) across the team.
Collaborate closely with Product, Engineering, and Data Science stakeholders to define acceptance criteria and quality gates, including for AI-driven features.
Own test planning, risk assessment, release sign-off, and reporting to leadership.
Stay current with emerging tools and techniques in AI/LLM testing and evaluation methodologies.
Required Skills & Experience
10–17 years of total QA/testing experience, including automation-focused roles.
Minimum 2 years of experience managing/leading a QA or automation team.
Solid hands-on expe
📌 Quality Assurance Manager Karnataka
🏢 Tekion
📍 Karnataka