**Job Title: Automation AI Test Engineer

Location: Chennai

Shift: Overlapping / Night shift

Experience: 3+

**Responsibilities

- Agentic Benchmark Design: Generate, import, create, extend, and manage benchmarks for non-deterministic LLM agents, validating behaviour and responses
- Functional Regression Testing: Grow benchmarks and create new ones as new functionality or issues are uncovered.
- Benchmarking Automation Support: Contribute to streamlining the benchmarking process in alignment with product development work. **Qualifications Basic Qualifications (Non-Negotiable)
- 3+ years of experience in software/product quality assurance.
- Confident usage of Bash and Python.
- Experience with manual testing and test case execution.
- Basic familiarity with automated testing frameworks such as Playwright or Selenium.
- Experience with testing web protocols (WebSocket message payload)
- Basic knowledge of load and performance testing (e.g.,



JMeter).
- Solid analytical and problem-solving abilities.

- Systems thinking
- Familiarity with prompt evaluation, function-calling, and tool-use testing. **Preferred Skills
- Exposure to test automation scripting using Python.
- Experience with CI/CD integration.
- Familiarity with Conversational AI platforms and NLP-based applications.
- Experience with test management and result tracking.
- Experience testing conversational-agent systems and evaluating non deterministic outputs. "},{"

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Automation AI Test Engineer (Chennai)
🏢 Sensiple
📍 Chennai