Country/Region: IN

Requisition ID: 38725

Work Model:

Position Type:

Salary Range:

Location: INDIA - BENGALURU - HP

Title: Technical Lead-AI QA

Description:

Area(s) of responsibility

AI QA Engineer – Agentic AI / GenAI

Role Overview

QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with solid Python expertise.

Key Responsibilities

- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration

Required Skills

- Strong Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control

Experience

7 years or more in QA experience, exposure to GenAI/ML systems

📌 Technical Lead-AI QA (India)
🏢 Birlasoft
📍 India