19 Nov
|
Hexaware Technologies
|
Hyderabad
19 Nov
Hexaware Technologies
Hyderabad
Job highlights
- Experience with Python, Selenium, Playwright, PyTest and expertise in Generative AI, LLMs, and LLM evaluation tools
- Develop and maintain automation frameworks; design and execute test strategies for GenAI and AI Agents; validate model quality and perform regression testing; automate API and end-to-end testing; collaborate with AI/ML teams
Required Skills
- Python, Selenium, Playwright, PyTest
- Generative AI, LLMs, AI Agents
- LLM evaluation tools: LangSmith, DeepEval, Ragas, Promptfoo
- Hallucination, accuracy, and regression testing
- API testing and automation frameworks
Key Responsibilities
- Develop and maintain automation frameworks using Python, Selenium, Playwright, and PyTest.
- Design and execute test strategies for GenAI, LLM, and AI Agent applications.
- Validate model quality, accuracy, robustness, and hallucination detection.
- Perform regression testing and benchmark AI model performance.
- Automate API and end-to-end testing.
- Work with AI/ML teams to improve reliability and quality of AI solutions.
Nice to Have
- Experience with LangChain, LangGraph, CrewAI, AutoGen
- Knowledge of RAG-based applications
- Exposure to Azure OpenAI, OpenAI, Claude, or Gemini
📌 Automation Test Engineer (Hyderabad)
🏢 Hexaware Technologies
📍 Hyderabad