About the Role
Nuvo AI is looking for an experienced QA Engineer / SDET with solid expertise in Manual Testing, Python-based Automation Testing, API Testing and exposure to AI/LLM applications. You will be responsible for ensuring the quality, reliability and performance of our AI-powered Patent Intelligence platform, working with technologies such as Generative AI, LLMs, RAG and Semantic Search.
Key Responsibilities
• Perform functional, regression, integration, exploratory and end-to-end testing.
• Design and execute test cases, test scenarios and test plans.
• Develop and maintain automated test scripts using Python with Playwright or Selenium.
• Perform API testing using Postman and validate REST APIs.
• Test AI/LLM applications, evaluating response accuracy, relevance, consistency and hallucinations.
• Validate RAG pipelines, semantic search, document retrieval and AI-generated responses.
• Perform database testing using SQL and PostgreSQL.
• Identify, report and track defects and collaborate with developers to resolve issues.
• Support performance testing, release validation and continuous quality improvement. Must-Have Skills
• 4–8 years of experience in Software Testing / Quality Assurance.
• Strong experience in Manual Testing and Automation Testing.
• Hands-on experience with Python-based automation using Playwright or Selenium WebDriver.
• Good understanding of REST API Testing and Postman.
• Working knowledge of SQL and PostgreSQL.
• Exposure to AI/LLM application testing, Generative AI or RAG-based applications.
• Strong understanding of test case design, defect management and end-to-end product testing. Good to Have
• Experience with LLM evaluation, hallucination testing and AI response validation.
• Knowledge of RAG, Vector Databases and Semantic Search.
• Experience testing SaaS, AI-powered or document intelligence platforms.
• Exposure to JIRA, CI/CD, OWASP and performance testing. Ideal Candidate We are looking for someone who has worked on complex software products, can independently handle end-to-end QA activities and has the ability to test both traditional software functionalities and AI-driven features. Interested candidates can share their updated resumes at: Keval.
[email protected]
📌 Senior QA Engineer – AI/LLM (Vapi)
🏢 Nuvo AI
📍 Vapi