- Develop and maintain comprehensive automated test suites for generative AI models, including language models,and multimodal systems
- Create creative testing strategies to validate the quality, coherence, and safety of AI-generated content
- Design and implement automation frameworks to test generative AI products across multiple platforms and use cases
- Collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems
- Develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios
- Implement automated tests for prompt engineering, fine-tuning processes, and model versioning
- Continuously improve testing methodologies to keep pace with constantly evolving generative AI technologies
- Analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement

📌 Senior AI QA Test Analyst (Bengaluru)
🏢 Calypso Technology
📍 Bengaluru