At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.
Senior AI Test / Automation Engineer
Overview
Role: AI Test / Automation Engineer
Location: Bangalore India
Department: AI Engineering / Quality Assurance
Experience Level: Mid to Senior
We are looking for a highly motivated Senior AI Test / Automation Engineer to design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. This role is critical to ensure that AI solutions meet enterprise standards for quality, reliability, safety, and compliance before and after production deployment.

Key Responsibilities
Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows
Develop comprehensive test suites, including:
Unit, integration, and end-to-end (E2E)
Functional, regression, performance, and safety testing
Validate AI system behavior, including:
Non-deterministic LLM outputs
Hallucinations and edge cases




Multi-step agent decision-making
Design and manage evaluation systems:
Golden datasets
Benchmarking pipelines (accuracy, latency, reliability)
Automate testing within CI/CD pipelines for model updates, prompt changes, and tool integrations
Implement observability and telemetry to enable traceability, monitoring, and audit readiness
Collaborate cross-functionally with ML, MLOps, Product, and Security teams to define quality gates and release criteria
Track and report quality KPIs, including test coverage, defect leakage, and system reliability
Drive root-cause analysis and continuous improvement across the AI testing lifecycle

Required Skills
Core Engineering
Solid programming skills in Python; familiarity with Bash, TypeScript, or Go
Experience with test automation frameworks such as PyTest, Playwright, Selenium, or Cypress
Proficiency in CI/CD tools (GitHub Actions, Jenkins, GitLab CI)
Experience with

📌 Principal Software Engineer Bengaluru (India)
🏢 Cadence Systems
📍 India