Tätigkeitsbereich:Forschung & Entwicklung incl. Design Fachabteilung:Powertrain Data Engineering Gesellschaft:Mercedes-Benz Research and Development India Private Limited Standort:Mercedes-Benz Research and Development India Private Limited, Bangalore Startdatum:01.11.2026 Veröffentlichungsdatum:12.10.2026 Stellennummer:MER00048YI Arbeitszeit:Vollzeit Aufgaben : AI QA Engineer (GenAI & ML Systems)

We hiring an AI QA Engineer to own the quality, reliability and safety of our GenAI and ML-driven engineering applications. You will define how we test non-deterministic systems, from prompts and RAG pipelines to agentic workflows, and set the release bar for AI features used across Powertrain Engineering.

Key Responsibilities

- Design evaluation frameworks for LLM, RAG and agentic systems: accuracy, hallucination, consistency, latency and cost

- Build golden datasets, regression suites and automated eval pipelines integrated into CI/CD

- Run red-teaming and adversarial tests: prompt injection, jailbreaks, data leakage, bias and toxicity

- Validate retrieval quality, tool-calling and multi-step agent behavior

- Define quality gates and release criteria for AI features

- Monitor production drift and failure modes; lead root-cause analysis with AI engineers

- Report quality metrics and risks to engineering leadership

Qualifikationen Required Qualifications :

- 4-8 years in QA/SDET,



including 1-2 years testing ML or GenAI systems

- Strong Python and test automation (pytest, API testing)

- Hands-on with LLM evaluation tools such as Ragas, DeepEval, promptfoo or LangSmith

- Working knowledge of LLM behavior, RAG architectures, embeddings and prompt engineering

- Statistical thinking: sampling, metric design, confidence, and the limits of LLM-as-judge

- CI/CD (GitHub Actions or Azure DevOps), Git and cloud fundamentals (Azure preferred)

Preferred Qualifications
- Experience with agent frameworks and MCP/tool integrations

- Observability tooling for tracing and drift monitoring

- Exposure to engineering or automotive domains

Who Qualifies

Skeptical by default, precise, comfortable with non-deterministic outputs, a clear writer, and a close collaborator to AI engineers.

Experience: 4-8 years

Employment: Full time

Benefits Mitarbeiterrabatte möglich Gesundheitsmaßnahmen Mitarbeiterhandy möglich Essenszulagen Betriebliche Altersversorgung Hybrides Arbeiten möglich Mobilitätsangebote Mitarbeiter Events Coaching Flexible Arbeitszeit möglich Kinderbetreuung Parkplatz Kantine, Café Gute Anbindung Barrierefreiheit Betriebsarzt Kontakt Mercedes-Benz Research and Development India Private Limited Plot No. 5-P, EPIP 1st Phase560066 BangaloreDetails zum Standort MBRDI Recruitment E-Mail: [email protected]

📌 AI QA Engineer (GenAI & ML Systems) (Bengaluru)
🏢 Mercedes-Benz Group
📍 Bengaluru