21 Nov
|
Zealant Consulting Group
|
India
21 Nov
Zealant Consulting Group
India
About the Role
We are looking for an experienced Lead Software Development Engineer in Test (Lead SDET) to lead quality engineering for our AI products. This role requires deep expertise in AI/ML testing, test automation architecture, and quality engineering strategy.
You will own the end-to-end quality charter for the AI vertical, define scalable testing methodologies, and architect robust, reusable, cross-platform automation frameworks. You will also drive organisation-wide quality initiatives, mentor engineering teams, and collaborate with cross-functional stakeholders to shape the AI quality roadmap.
The ideal candidate is a robust technical leader who can make independent decisions on testing strategies, frameworks, tools, and methodologies while ensuring the reliability, scalability, and quality of AI-driven products.
Key Responsibilities
- Quality Strategy & Leadership: Define and own the overall QA strategy and end-to-end quality charter for the AI vertical.
- Automation Architecture: Design and architect large-scale, reusable, scalable, and cross-platform test automation frameworks.
- AI & Model Testing: Develop comprehensive testing strategies for AI/ML systems, including RAG pipelines, hallucination detection, model drift, bias, and output accuracy.
- AI Quality Roadmap: Drive the AI quality roadmap, establish testing standards, and implement organisation-wide quality initiatives.
- Technical Ownership: Own key decisions related to test strategy, automation tools, frameworks, and AI testing methodologies.
- Team Leadership: Mentor, coach, and upskill the QA/SDET team, establish engineering best practices, and build a strong talent pipeline.
- Cross-functional Collaboration: Influence engineering, product, and architecture teams to embed quality throughout the product development lifecycle.
- Risk & Reliability Management: Identify and mitigate product and model-level quality risks while improving system reliability, scalability, and test coverage.
- Continuous Improvement: Establish quality metrics,
improve testing efficiency, and drive continuous improvement across the organisation.
Required Skills & Experience
- 7+ years of overall experience in Software Quality Assurance (QA), Test Automation, or SDET roles.
- Deep expertise in AI/ML testing, including testing AI tools, models, and AI-powered applications.
- Hands-on experience designing testing methodologies for RAG pipelines, hallucination detection, model drift, bias, and AI output evaluation.
- Proven experience architecting large-scale, reusable, and cross-platform test automation frameworks.
- Strong understanding of software testing methodologies, automation architecture, and quality engineering practices.
- Demonstrated experience leading and mentoring QA/SDET teams, setting technical standards, and driving engineering excellence.
- Ability to independently define testing strategies and make technical decisions regarding tools, frameworks, and methodologies.
- Strong stakeholder management and communication skills, with the ability to influence cross-functional teams and participate in system architecture discussions.
- Experience owning end-to-end quality engineering strategy at a product, platform, or vertical level.
Good to Have
- Experience working with CI/CD pipelines and integrating automated testing into continuous delivery workflows.
- Exposure to cloud platforms such as AWS, GCP, or Microsoft Azure.
- Familiarity with MLOps pipelines, model lifecycle management, and monitoring AI systems in production.
- Experience with performance, load, and scalability testing of AI/ML workloads.
- Familiarity with AI evaluation frameworks and tools for assessing model quality and reliability.
What Success Looks Like
- A well-defined and scalable quality engineering strategy for the AI vertical.
- Robust automation frameworks with high reusability and maintainability.
- Reliable testing methodologies for RAG, hallucination, bias, and model drift.
- Improved product quality, reduced engineering risks, and better release confidence.
- A technically strong and independently operating QA/SDET team.
📌 Lead SDET – AI Product Automation Testing (India)
🏢 Zealant Consulting Group
📍 India