Roles & Responsibilities Python + GenAI/AI Testing
Develop Python + PyTest automation frameworks for AI/GenAI applications.
Test Chatbots, GenAI apps, LLMs, RAG pipelines and AI agents.
Automate API, functional, integration, regression and UAT testing.
Validate AI outputs for accuracy, relevance, hallucination, consistency and response quality.
Use tools/frameworks such as LangSmith, LangChain/LangGraph or Agentic AI frameworks for testing.
Build automated test scripts for AI pipelines and microservices.
Integrate automation with Git/GitHub and CI/CD pipelines.
Analyze test results, identify AI/model issues and report defects.
Work with Azure/AWS and databases for end-to-end AI application testing.
📌 Assistant Manager Automation Testing Bengaluru (India)
🏢 VBeyond
📍 India