Contractor Area(s) of responsibility AI QA Engineer – Agentic AI / GenAI Role Overview QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities Develop Python-based automation frameworks (Pytest) Test LLM outputs (accuracy, hallucination, relevance) Validate multi-agent workflows and pipelines Build evaluation metrics (F1, precision, recall) Perform API and integration testing Ensure high test coverage and CI/CD integration Required Skills Solid Python programming Automation frameworks (Pytest/unittest) Understanding of GenAI/LLMs API testing and debugging CI/CD and version control Experience Level Senior Level