We are currently seeking a Quality Engineer to join our team in Remote, Karnataka (IN-KA), India (IN).
Responsibilities
Lead the discovery (Current state) and Documentation that will produce 5 deliverables:
Enterprise Testing Strategy
QE Handbook
Automation Handbook
Perf Engineering Handbook
Test Enablers
Evaluate and maintain the testing strategies, approaches, tools and frameworks used by the teams.
Design, develop and execute test automation frameworks and test automation suites.
Provide regular quality and status reports.
Participate in project-wide reviews of requirements, system architecture and detailed design documents.
Act as key point of contact for other Quality Engineers across multiple teams.
Identify and resolve issues that arise when integrating the application software with other software components.
Mentor and guide other Quality Engineers on the QA Process, the testing strategy, tools and frameworks being used and assist them in growing their careers.
Conduct regular performance reviews and conduct interviews.
Develop testing strategies for AI-generated outputs: structured extraction accuracy measurement, confidence score calibration validation, and regression testing across model or prompt changes
Design test harnesses for non-deterministic LLM outputs define acceptable output schemas, boundary conditions, and automated assertion patterns that account for natural response variation
Build integration test suites for the RAG pipeline: retrieval precision/recall measurement, embedding drift detection, and few-shot example quality validation
Author contract tests for all external integration adapters to detect upstream API changes before they reach production; experience with consumer-driven contract testing patterns (e.g., Pact) a plus
Design and execute performance tests against LLM inference endpoints to validate throughput, latency SLAs, and GPU utilization under concurrent engineer loa
📌 Quality Engineer Mumbai (India)
🏢 NTT DATA Business Solutions
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.