25 Aug
|
Birlasoft
|
Bengaluru
25 Aug
Birlasoft
Bengaluru
Subcontractor- Gen AI QA Area(s) of responsibility AI QA Engineer – Agentic AI / GenAI Role Overview QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities • Develop Python-based automation frameworks (Pytest) • Test LLM outputs (accuracy, hallucination, relevance) • Validate multi-agent workflows and pipelines • Build evaluation metrics (F1, precision, recall) • Perform API and integration testing • Ensure high test coverage and CI/CD integration Required Skills • Robust Python programming • Automation frameworks (Pytest/unittest) • Understanding of GenAI/LLMs • API testing and debugging • CI/CD and version control Experience 7 years or more in QA experience, exposure to GenAI/ML systems Experience Level Senior Level
📌 Senior AI Quality Assurance Engineer - Generative AI (Bengaluru)
🏢 Birlasoft
📍 Bengaluru