About the Role
Nuvo AI is looking for an experienced QA Engineer / SDET with strong expertise in Manual Testing, Python-based Automation Testing, API Testing and exposure to AI/LLM applications.
You will be responsible for ensuring the quality, reliability and performance of our AI-powered Patent Intelligence platform, working with technologies such as Generative AI, LLMs, RAG and Semantic Search.
Key Responsibilities
- Perform functional, regression, integration, exploratory and end-to-end testing.
- Design and execute test cases, test scenarios and test plans.
- Develop and maintain automated test scripts using Python with Playwright or Selenium.
- Perform API testing using Postman and validate REST APIs.
- Test AI/LLM applications, evaluating response accuracy, relevance, consistency and hallucinations.
- Validate RAG pipelines, semantic search, document retrieval and AI-generated responses.
- Perform database testing using SQL and PostgreSQL.
- Identify, report and track defects and collaborate with developers to resolve issues.
- Support performance testing, release validation and continuous quality improvement.
Must-Have Skills
- 4–8 years of experience in Software Testing / Quality Assurance.
- Strong experience in Manual Testing and Automation Testing.
- Hands-on experience with Python-based automation using Playwright or Selenium WebDriver.
- Positive understanding of REST API Testing and Postman.
- Working knowledge of SQL and PostgreSQL.
- Exposure to AI/LLM application testing, Generative AI or RAG-based applications.
- Strong understanding of test case design, defect management and end-to-end product testing.
Good to Have
- Experience with LLM evaluation, hallucination testing and AI response validation.
- Knowledge of RAG, Vector Databases and Semantic Search.
- Experience testing SaaS, AI-powered or document intelligence platforms.
- Exposure to JIRA, CI/CD, OWASP and performance testing.
Ideal Candidate
We are looking for someone who has worked on complex software products, can independently handle end-to-end QA activities and has the ability to test both traditional software functionalities and AI-driven features.
Interested candidates can share their updated resumes at:
[email protected]
📌 Senior QA Engineer – AI/LLM & Automation Testing (Vapi)
🏢 Nuvo AI
📍 Vapi