Description
Ciklum is looking for a Senior Manual QA Engineer (AI / LLM & API Testing) to join our team full time in India.
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Manual QA Engineer (AI / LLM & API Testing), become a part of a cross-functional development team engineering experiences of tomorrow.
Client is looking for a QA Engineer to test an AI-powered knowledge management and retrieval platform. The solution includes document processing, RAG-based search, LLM-generated answers and integrations with external systems. An optimal candidate should be able to test traditional software features and AI-specific behavior (e.g. hallucination detection, referencing sources, confidence scores, PII handling).
Responsibilities:




- E2E testing of multi-format document processing (PDFs, Word, PPT, images/screenshots) and parsing accuracy (OCR/Vision extraction)
- Performing standard test activities: acceptance criteria refinement, test scenario creation, execution, reporting, defect management, and regression testing
- Validation of RAG retrieval quality, including hybrid search (semantic + BM25 keyword search), metadata filtering, and retrieval scoping
- Verification of probabilistic AI outputs for answer grounding, hallucination risk, source references, and confidence scores
- E2E testing of human-in-the-loop content workflows (AI draft generation, confidence score thresholds, reviewer approvals, and vector DB publishing sync)
- API and enterprise integration testing (portals, chatbots, ticketing systems) across deterministic and non-deterministic flows
- Validation of data protection controls, including PII scanning and redaction
- Support QA automat

📌 Senior Manual QA Engineer (India)
🏢 Ciklum
📍 India