This is a permanent role with one of the valued client of Zyoin Group. Key Responsibilities & Skills
- Automation Tester who has tested AI Products
- Product Testing Strategy - someone who has worked upon
- API testing, Automation Framework, BDD, Python + Behave, Git Version Control
- Evaluation reporting and communication, CI/CD Integration
- LLM Evaluation and Testing for Accuracy, relevance, and context of responses or outputs
- Feedback mechanism and continuous validation
- Testing for Bias, Safety and non-subjective response handling / fall back
- Basic performance testing including p50 / p95, response time SLA, and load testing
- Data storage,
traceability, and auditability
- Handling edge cases, harmful prompts, etc.
- Any legal framework application for testing before production
Nice to Have:
- Experience working with Generative AI or LLM-based applications in production environments
- Exposure to AI governance, responsible AI, or model risk management practices
- Familiarity with cloud platforms (AWS, GCP, or Azure) and cloud-based CI/CD pipelines
- Experience collaborating closely with data scientists and ML engineers
- Understanding of prompt engineering and prompt versioning concepts
- Prior experience in regulated domains such as fintech, healthcare, or enterprise SaaS
📌 AI Quality Engineer (Bengaluru)
🏢 ICE
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.