Job Title: Automation AI Test Engineer
Location: Chennai
Shift: Overlapping / Night shift
Experience: 3+

Responsibilities
Agentic Benchmark Design: Generate, import, create, extend, and manage benchmarks for non-deterministic LLM agents, validating behaviour and responses
Functional Regression Testing: Grow benchmarks and create recent ones as recent functionality or issues are uncovered.
Benchmarking Automation Support: Contribute to streamlining the benchmarking process in alignment with product development work.

Qualifications Basic Qualifications (Non-Negotiable)
3+ years of experience in software/product quality assurance.
Confident usage of Bash and Python.
Experience with manual testing and test case execution.
Basic familiarity with automated testing frameworks such as Playwright or Selenium.
Experience with testing web protocols (WebSocket message payload)
Basic knowledge of load and performance testing (e.g.,



JMeter).
Robust analytical and problem-solving abilities.
Systems thinking
Familiarity with prompt evaluation, function-calling, and tool-use testing.

Preferred Skills
Exposure to test automation scripting using Python.
Experience with CI/CD integration.
Familiarity with Conversational AI platforms and NLP-based applications.
Experience with test management and result tracking.
Experience testing conversational-agent systems and evaluating non deterministic outputs.

"},{"

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Automation Ai Test Engineer Chennai
🏢 Sensiple
📍 Chennai