24 Aug
|
Birlasoft
|
India
Area(s) of Responsibility AI QA Engineer - Agentic AI / GenAI
Role Overview QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration
Required Skills
- Solid Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control
Experience 7 years or more in QA experience, exposure to GenAI/ML systems
Locations
- Country/Region: IN
- Requisition ID: 38725
- Work Model:
- Position Type:
- Salary Range:
- Location: INDIA - BENGALURU - HP
📌 Title:
Technical Lead-AI QA (India)
🏢 Birlasoft
📍 India