Sr Architect Area(s) of responsibility Key Responsibilities Develop Python-based automation frameworks (Pytest) Test LLM outputs (accuracy, hallucination, relevance) Validate multi-agent workflows and pipelines Build evaluation metrics (F1, precision, recall) Perform API and integration testing Ensure high test coverage and CI/CD integration Required Skills Solid Python programming Automation frameworks (Pytest/unittest) Understanding of GenAI/LLMs API testing and debugging CI/CD and version control Experience Level Senior Level