Requirements

- Experience: 5+ years in software testing or automation for web applications, SaaS platforms, or large-scale systems

- Technical Depth: Proven expertise in designing and maintaining test automation frameworks (Playwright, Cypress, Selenium, etc.)

- Programming Skills: Strong in TypeScript, JavaScript, or Python — capable of writing scalable, maintainable automation code

- MUST HAVE : RAG Testing and AI Product Testing, RAG Architecture, Retrieval Testing, Prompt Engineering Testing

- Infrastructure Knowledge: Hands-on experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab) and containerized environments (Docker, Kubernetes)

- Cloud Proficiency: Working knowledge of GCP or AWS for test infrastructure and environment setup

- API & Backend Testing: Deep understanding of RESTful APIs, request validation, and integration testing

- Observability & Reporting: Familiarity with test reporting dashboards, metrics tracking, and alerting (Grafana, Prometheus, Slack integrations)

- Debugging Skills: Strong ability to diagnose failures in distributed systems and identify root causes quickly

- Architecture Awareness: Solid understanding of system design, micro-services, databases, and data flow across layers

- Soft Skills: Excellent communication, documentation, and collaboration skills with a cross-functional mindset

- Mindset: Ownership-driven, curious about platform scalability, and passionate about building tools that enable others to test better





Responsibilities

- Own and evolve the test automation platform, ensuring scalability, reliability, and ease of use

- Design and maintain robust automation frameworks across UI, API, and backend layers

- Build and enhance internal QA tools that improve test efficiency

- Drive adoption of automation best practices, coding standards, and effective test design

- Implement and maintain test observability systems for reporting, analytics, and defect insights

- Conduct performance, load, and scalability testing for key features and services

- Develop and maintain test infrastructure, supporting containerized and distributed environments

- Collaborate closely with developers, QA, and DevOps to embed quality throughout the delivery pipeline

- Improve test reliability and flakiness detection through intelligent retry and failure analysis systems

- Contribute to continuous improvement of tooling, test data management, and CI/CD quality gates

- Research and implement emerging technologies (AI/ML, LLMs, smart test generation, etc.) to advance test automation capabilities

- Advocate for shift-left quality, influencing design and architecture discussions for better testability

- Maintain clear documentation and onboarding materials for test frameworks and platform usage

Skills: llm testing,ragas,ai test engineer,retrieval testing,prompt engineering,rag evaluation,python,javascript

📌 SDET - III (RAGas Automation Testing) (India)
🏢 Zealant Consulting Group
📍 India