We are looking for an AI Testing Engineer with experience in software testing, Python automation, and validation of AI-powered applications.
Key Responsibilities:
- Perform functional, API, integration, and regression testing of AI applications.
- Validate AI/ML and Generative AI outputs for accuracy and reliability.
- Test LLM responses, prompts, and hallucinations.
- Develop automated test scripts using Python and PyTest.
- Identify defects and collaborate with development teams to resolve issues.
Required Skills:
- 3 - 5 years of experience in software testing.
- Robust Python and test automation skills.
- Experience in API testing using Postman.
- Knowledge of AI/ML, Generative AI, and LLM testing.
- Hands-on experience in evaluation testing (Eval Testing) of AI/LLM applications, including response quality, accuracy, relevance, and consistency.
- Understanding of SQL, Git, and defect-tracking tools such as Jira.
Preferred:
- Hands-on experience with RAG applications and AI evaluation frameworks such as DeepEval or Ragas.
📌 Neoware - AI Test Engineer - Python/Automation (India)
🏢 Neoware Technology Solutions
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.