Job Post - AI QA Engineer

Experience - 2+ years

Location - Ahmedabad (work from office)

Job Summary

We're looking for an AI QA Engineer to own quality across our growing portfolio of AI-powered products custom dashboards, AI CRMs, RFP platforms, lead-gen systems, agentic workflows, and automations delivered to agency clients across the US, UK, and AU. This role spans both the AI layer (prompts, agents, RAG, model outputs) and the full application stack around it (web app UI, APIs, databases, integrations, multi-tenant access). You'll catch issues that traditional QA misses
and
the ones that pure ML evaluation misses the messy middle where a working model still ships a broken product.

Key Responsibilities

AI & LLM Quality
Design test strategies for LLM-powered features, agents, RAG systems, and workflow automations (n8n, custom pipelines, MCP-based systems)
Build and maintain golden datasets, evaluation suites, and prompt regression tests so model or prompt changes don't silently break production
Validate output quality across factual accuracy,



format adherence, tone, hallucination rate, instruction-following, and refusal behavior
Test agentic and multi-step workflows end-to-end tool calls, handoffs, error recovery, loop detection, cost and latency under load
Stress-test RAG pipelines: retrieval accuracy, chunking quality, context relevance, citation correctness
Run adversarial testing prompt injection, jailbreak attempts, malformed inputs, edge-case client data

Custom App & Platform Quality
Own end-to-end QA for custom-built applications: dashboards, AI CRMs, client portals, and internal tools
Functional, regression, cross-browser, and responsive testing across web UIs (Next.js, React, similar stacks)
API testing for REST endpoints, webhooks, and third-party integrations (CRMs, email, calendars, payment, file storage)
Database and data-integrity testing especially for multi-tenant architectures where one client's data must never leak

📌 Ai Qa Engineer Ahmedabad
🏢 Huptech HR Solutions
📍 Ahmedabad