About LetitbexAI LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.

Position: AI Testing / Model Validation Specialist

Experience: 3-5 Years

Notice Period: Can be considered up 15 Days

Role Summary

Develop and execute comprehensive testing strategies for AI-powered features in various modules. Ensure quality, reliability, and ethical soundness of AI components.

Key Responsibilities

- Develop test plans and strategies for AI-powered recruitment features
- Design test datasets and evaluation suites for model validation
- Execute functional and performance testing of AI components
- Conduct fairness and bias testing on AI-driven decisions
- Implement automated testing frameworks for ML models
- Perform edge case and adversarial testing
- Create dashboards and reports on AI feature quality metrics




- Collaborate with ML engineers on model improvement recommendations
- Document known limitations and edge cases
- Support A/B testing and champion-challenger evaluations

Required Skills & Experience

- 3-5 years of QA experience with exposure to AI/ML products
- Understanding of ML concepts, evaluation metrics, and testing methodologies
- Strong analytical skills and attention to detail
- Proficiency in Python or similar language for test automation
- Experience with test automation frameworks and tools
- Knowledge of statistical testing and data analysis
- Robust communication and documentation abilities

Nice to Have
- Experience with fairness and bias evaluation frameworks
- Knowledge of NLP and language model testing
- Familiarity with ML evaluation platforms or tools
- Experience with automated testing for ML systems
- SQL knowledge for data exploration

📌 AI Testing / Model Validation Specialist (Hyderabad)
🏢 Letitbex AI
📍 Hyderabad