About the Role:

We are looking for an experienced Lead QA - Python & AI to lead quality engineering initiatives, develop scalable automation frameworks, and ensure the reliability and performance of AI-powered applications.

Key Responsibilities:

- Lead end-to-end quality assurance activities, including test planning, test design, automation, execution, and reporting.
- Design, develop, and maintain scalable test automation frameworks using Python.
- Lead functional, regression, integration, API, and end-to-end testing.
- Develop testing strategies for AI/ML applications, including model validation, accuracy, reliability, and performance testing.
- Validate AI-generated outputs for correctness, consistency, bias, and unexpected behaviour.
- Test AI/LLM-based applications, including prompt validation, response quality, and hallucination detection.
- Integrate automated tests into CI/CD pipelines to support continuous testing.
- Collaborate with developers, data scientists, ML engineers, and product teams to define quality standards.
- Identify, investigate,



and troubleshoot defects, perform root-cause analysis, and drive resolution.
- Establish quality metrics, automation coverage, and reporting mechanisms.
- Mentor QA engineers, review automation code, and promote best practices.

Required Skills:

- 10 - 14 years of experience in Quality Assurance or Test Automation.
- Strong hands-on expertise in Python programming and frameworks like Pytest, Selenium, or Playwright.
- Experience testing AI/ML-based applications and validating model outputs.
- Knowledge of REST APIs, SQL, and test data management.
- Experience with Git, CI/CD pipelines (Jenkins, GitHub Actions).
- Experience leading QA teams and defining test strategies.

Valuable to Have:

- Experience with LLM testing and Generative AI applications.
- Exposure to AI evaluation frameworks and cloud platforms (AWS, Azure, GCP).
- Knowledge of performance testing tools and observability practices.

📌 Accion Labs - Lead Quality Assurance Engineer - Python (India)
🏢 Accion Labs
📍 India