Senior QA Engineer – AI/LLM (Vapi)

Senior QA Engineer – AI/LLM (Vapi)

17 Nov
|
Nuvo AI
|
Vapi

17 Nov

Nuvo AI

Vapi

About the Role
Nuvo AI is looking for an experienced QA Engineer / SDET with solid expertise in Manual Testing, Python-based Automation Testing, API Testing and exposure to AI/LLM applications. You will be responsible for ensuring the quality, reliability and performance of our AI-powered Patent Intelligence platform, working with technologies such as Generative AI, LLMs, RAG and Semantic Search.

Key Responsibilities
• Perform functional, regression, integration, exploratory and end-to-end testing.
• Design and execute test cases, test scenarios and test plans.
• Develop and maintain automated test scripts using Python with Playwright or Selenium.
• Perform API testing using Postman and validate REST APIs.
• Test AI/LLM applications, evaluating response accuracy, relevance, consistency and hallucinations.
• Validate RAG pipelines, semantic search, document retrieval and AI-generated responses.
• Perform database testing using SQL and PostgreSQL.
• Identify, report and track defects and collaborate with developers to resolve issues.
• Support performance testing, release validation and continuous quality improvement. Must-Have Skills




• 4–8 years of experience in Software Testing / Quality Assurance.
• Strong experience in Manual Testing and Automation Testing.
• Hands-on experience with Python-based automation using Playwright or Selenium WebDriver.
• Good understanding of REST API Testing and Postman.
• Working knowledge of SQL and PostgreSQL.
• Exposure to AI/LLM application testing, Generative AI or RAG-based applications.
• Strong understanding of test case design, defect management and end-to-end product testing. Good to Have
• Experience with LLM evaluation, hallucination testing and AI response validation.
• Knowledge of RAG, Vector Databases and Semantic Search.
• Experience testing SaaS, AI-powered or document intelligence platforms.
• Exposure to JIRA, CI/CD, OWASP and performance testing. Ideal Candidate We are looking for someone who has worked on complex software products, can independently handle end-to-end QA activities and has the ability to test both traditional software functionalities and AI-driven features. Interested candidates can share their updated resumes at: Keval.
[email protected]

📌 Senior QA Engineer – AI/LLM (Vapi)
🏢 Nuvo AI
📍 Vapi

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior qa engineer – ai/llm (vapi) / vapi

Subscribe to this job alert:

Get the latest job offers by email for: senior qa engineer – ai/llm (vapi) / vapi