19 Aug
|
Birlasoft
|
Bengaluru
19 Aug
Birlasoft
Bengaluru
Area(s) of responsibility
AI QA Engineer – Agentic AI / GenAI
Role Overview
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
Develop Python-based automation frameworks (Pytest)
Test LLM outputs (accuracy, hallucination, relevance)
Validate multi-agent workflows and pipelines
Build evaluation metrics (F1, precision, recall)
Perform API and integration testing
Ensure high test coverage and CI/CD integration
Required Skills
Solid Python programming
Automation frameworks (Pytest/unittest)
Understanding of GenAI/LLMs
API testing and debugging
CI/CD and version control
Experience
7 years or more in QA experience, exposure to GenAI/ML systems
📌 Technical Lead-AI QA (Bengaluru)
🏢 Birlasoft
📍 Bengaluru