Role- AI Product Experience Harness
Location- Noida & Hyderabad
Experience- 15-21 Years
Role Summary:
Build and run the automated harness that validates the delivered product against the experience specification and the AI compliance/guardrail specification, so validation is a pipeline, not a headcount. This role executes automated checks against criteria that the Experience lead (functional/visual/accessibility) and the Compliance lead (safety/red-team/regulatory) define — it does not independently set the bar for what "pass" means; it makes "pass" mechanically checkable and evidence-backed.
Key Responsibilities:
Functional & experience validation:
Build automated end-to-end test suites (Playwright or Cypress) covering critical user flows
Build visual-regression testing into the pipeline (screenshot diffing against approved baselines)
Build automated accessibility test suites (WCAG 2.1/2.2 AA conformance checks)
Convert every experience-spec acceptance criterion into an executable check; flag criteria that cannot be automated and require manual review — this is a real skill, not a formality: a spec clause like "feels responsive" needs to become a measurable threshold (e.g., time-to-first-token, time-to-interactive) before it's testable
AI/agentic-specific validation:
Build automated checks for agentic UI states defined by the Experience spec streaming/incremental rendering correctness, progress-indicator accuracy during multi-step agent tasks, correct rendering of failure/retry/escalation states
Build and run automated red-team regression suites (using tools defined by/coordinated with the Compliance role) so that known jailbreak/injection/PII-leakage test cases are re-run on every release, not just at initial audit
Automate LLM output evaluation checks — factual consistency, refusal-behavior conformance, format/schema conformance — as repeatable pipeline gates rather than one-off manual review
Operations:
Run the harness against CTO org deliveries; produce p
📌 AI Product Experience Harness (Noida)
🏢 HCLTech
📍 Noida
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.