Role at a GlancenRole: AI Quality Engineer (Playwright Automation)nExperience: 36 YearsnEngagement: Full-Time | On-Site / HybridnDomain: AI-First Enterprise Procurement SaaSnCore Stack: Playwright TypeScript/JavaScript Python REST APIs SQLnReporting To: Head of Quality EngineeringnTeam Context: Embedded in AI Product SquadsnnTHE PROSPECTnWe are looking for a seasoned AI Quality Engineer with 36 years of hands-on experience to join our Quality Engineering team. This is not a conventional QA role. You will be embedded in our AI product squads, designing and executing intelligent test strategies that validate not just functionality, but the behaviour, accuracy, fairness, and reliability of AI-driven features on a live enterprise SaaS platform.nnYou won't just test software. You'll safeguard the intelligence powering enterprise procurement for the world's leading organizations.nnKEY RESPONSIBILITIESnAI u0026 Intelligent Feature TestingnDesign and execute end-to-end test strategies for AI-driven procurement features including supplier recommendations, spend classification, contract risk analysis, and demand forecasting.nDevelop robust test suites using Playwright to validate AI model outputs, UI behaviours, and data flows across the full application stack.nDefine and implement test cases for non-deterministic AI features including boundary testing, edge case exploration, hallucination detection, and bias assessment.nBuild evaluation frameworks to measure and track model accuracy, consistency, recall, and precision across releases.nCollaborate with AI/ML engineers and data scientists to validate training data quality, model versioning, and inference pipeline correctness.nAutomation Framework EngineeringnArchitect, build, and scale a Playwright-based automation framework (TypeScript/JavaScript) supporting UI, API,



and component-level testing.nDesign Page Object Models (POM), fixtures, and reusable test utilities that enable rapid test authoring across multiple product areas.nImplement self-healing selectors and intelligent wait strategies to handle AI-driven dynamic content and async rendering.nIntegrate test suites into CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) to enable shift-left, continuous quality enforcement.nMaintain test result dashboards, flakiness tracking, and failure triage workflows to ensure signal-to-noise discipline in the automation suite.nAPI u0026 Data ValidationnValidate REST and GraphQL API contracts through Playwright's API testing capabilities, ensuring AI service integrations behave correctly under all conditions.nWrite SQL queries to verify data integrity across procurement entities POs, invoices, supplier records, contracts pre- and post-AI processing.nDesign data-driven test scenarios leveraging realistic procurement datasets to stress-test AI features at scale.nPerform response schema validation, latency benchmarking, and error boundary testing on AI inference APIs.nPerformance,



Security u0026 ReliabilitynLead performance testing initiatives to ensure AI-powered features meet SLA requirements under realistic enterprise load conditions.nCollaborate with security teams to perform penetration and vulnerability testing on AI API endpoints and data pipelines.nDesign and execute chaos and resilience tests to validate system behaviour during AI model degradation or outage scenarios.nMonitor production AI model drift and work with MLOps teams to define quality gates for model redeployment decisions.nQuality Leadership u0026 CulturenChampion a quality-first engineering culture by embedding testing discipline into sprint ceremonies, design reviews, and definition of done.nMentor junior QA engineers on Playwright, automation best practices, and AI-specific testing methodologies.nProduce comprehensive test plans, risk assessments, and quality reports for product leadership and enterprise stakeholders.nContinuously evaluate and introduce next-generation testing tools, AI-assisted test generation platforms, and quality intelligence solutions.nnKEY SKILLSnPlaywright u0026 Automation (Must-Have)n36 years of hands-on Playwright experience with TypeScript or JavaScript portfolio or GitHub evidence strongly preferred.nDeep expertise in Playwright features: network interception, storage state, fixtures, parallel execution, trace viewer, and visual comparison.nStrong understanding of test design patterns: POM, screenplay pattern, data-driven, and BDD with Cucumber or Gherkin.nExperience building and maintaining large-scale automation suites (500+ tests) with low flakiness and high maintainability.nProficiency in CI/CD integration configuring Playwright in GitHub Actions, Jenkins, Azure Pipelines, or equivalent.nAI u0026 ML Quality Expertise (Must-Have)nDemonstrated experience testing AI/ML-powered features NLP, recommendation engines, classification models, or generative AI outputs.nUnderstanding of AI quality concepts: hallucination, model drift, data bias, fairness metrics, confidence .

📌 AI Quality Engineer (India)
🏢 ACADS360 INDIA PRIVATE
📍 India