We are currently seeking a Quality Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN).
Responsibilities and Qualifications:
- Lead the discovery (Current state) and Documentation that will produce 5 deliverables:
- Enterprise Testing Strategy
- QE Handbook
- Automation Handbook
- Perf Engineering Handbook
- Test Enablers
- Evaluate and maintain the testing strategies, approaches, tools and frameworks used by the teams.
- Design, develop and execute test automation frameworks and test automation suites.
- Provide regular quality and status reports.
- Participate in project-wide reviews of requirements, system architecture and detailed design documents.
- Act as key point of contact for other Quality Engineers across multiple teams.
- Mentor and guide other Quality Engineers on the QA Process, the testing strategy, tools and frameworks being used and assist them in growing their careers.
- Conduct regular performance reviews and conduct interviews.
- Develop testing strategies for AI-generated outputs:
structured extraction accuracy measurement, confidence score calibration validation, and regression testing across model or prompt changes
- Design test harnesses for non-deterministic LLM outputs — define acceptable output schemas, boundary conditions, and automated assertion patterns that account for natural response variation
- Build integration test suites for the RAG pipeline: retrieval precision/recall measurement, embedding drift detection, and few-shot example quality validation
- Author contract tests for all external integration adapters to detect upstream API changes before they reach production; experience with consumer-driven contract testing patterns (e.g., Pact) a plus
- Design and execute performance tests against LLM inference endpoints to validate throughput, latency SLAs, and GPU utilization under concurrent engineer load
- Develop test cases for human-in-the-loop workflow paths: review queue routing logic, SME correct
📌 Quality Engineer (Karnataka)
🏢 NTT
📍 Karnataka
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.