About the Company We are looking for a highly skilled Senior AI Platform QA Engineer to ensure the reliability, accuracy, and performance of our AI-based patent platform.
You will actively break systems, analyze Next.js code flows, and validate complex LLM-driven workflows. You will work across frontend, backend, and AI layers—acting as a quality gatekeeper before production.
Full-Stack & Architecture Testing
Next.js Frontend: Perform deep functional and integration testing. Analyze components, hooks, and state management to identify SSR/CSR edge cases and performance bottlenecks.
Backend & API: Validate REST/GraphQL API contracts, payload integrity, and authentication flows. Perform multi-user concurrent testing to identify race conditions.
Database Integrity: Test CRUD operations, transactions, and rollbacks. Ensure data consistency across vector databases (Pinecone/FAISS) and relational schemas.
AI & LLM Module Validation
Patent Search & RAG: Validate relevancy ranking, vector search accuracy, and the quality of retrieved context.
Agent Workflows: Test LLM-powered multi-step agents for autonomy behaviors, 'looping' issues, and edge-case handling.
Validate datasets and monitor training runs to benchmark model performance.
Quality Ownership & Engineering
Code Review: Review frontend and backend code from a testability perspective,
identifying anti-patterns and suggesting better error handling.
Validate logging, monitoring, and failover recovery. Experience: 3–6 years in QA Engineering, with significant experience in Full-Stack web applications.
Frontend Mastery: Deep understanding of Next.js/React (SSR, hydration, client-side hooks) and Browser DevTools.
Backend & API: Expert at testing APIs (Postman, curl) and understanding Node.js/Python logic.
AI Knowledge: Hands-on experience with:
LLMs: OpenAI API, Ollama, or local model orchestration.
Vector Tech: RAG pipelines and vector databases (Pinecone, Weaviate, etc.).
Testing Mindset: Tools: Proficiency in Jira/TestRail and exposure to automation frameworks like Playwright, Cypress, or PyTest. Experience with Docker, CI/CD pipelines, and cloud platforms (AWS/GCP).
Experience with LLM evaluation frameworks (e.g., Performance/Load testing exposure using tools like k6 or Locust.
You are a Quality Advocate: You are comfortable challenging implementations when quality or user experience is at risk.
You are AI-Curious: You stay updated on the latest in LLMs and agentic frameworks.
Chance to work at the intersection of Generative AI and LegalTech. Freedom to explore and implement new testing methodologies for AI.
📌 AI Software Developer (Vapi)
🏢 Meril
📍 Vapi