The Team

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.

Your work profile

We are looking for a Senior Quality Engineer with robust expertise in Playwright with Python, API automation, and AI/LLM testing. The role will own the quality strategy, develop scalable automation frameworks, and ensure the accuracy, safety, reliability, performance, and compliance of AI-powered applications.

Key skills required

• Own the end-to-end test strategy, automation roadmap, quality gates, and release-readiness criteria.




• Design and maintain automation frameworks using Playwright with Python and BDD using Behave.
• Automate UI, API, integration, regression, and end-to-end testing.
• Support UAT automation and maintain existing regression suites using Selenium, where required.
• Validate AI/LLM systems for accuracy, relevance, hallucination, bias, safety, context retention, and fallback handling.
• Test prompt injection, harmful prompts, edge cases, RAG workflows, and AI agent integrations.
• Build LLM evaluation frameworks, benchmark datasets, scorecards, and regression suites.
• Integrate automated tests into CI/CD pipelines and implement continuous quality gates.
• Conduct basic performance testing covering p50/p95 response times, throughput, load, and SLA compliance.
• Debug issues using logs, traces, database validation, and backend monitoring.
• Define quality dashboards and ensure traceab

📌 Python Automation Engineer (Mumbai)
🏢 Deloitte
📍 Mumbai