Role-
AI Product Experience Harness
Location-
Noida & Hyderabad
Experience-
15-21 Years
Role Summary:
Build and run the automated harness that validates the delivered product against the experience specification and the AI compliance/guardrail specification, so validation is a pipeline, not a headcount. This role executes automated checks against criteria that the Experience lead (functional/visual/accessibility) and the Compliance lead (safety/red-team/regulatory) define — it does not independently set the bar for what "pass" means; it makes "pass" mechanically checkable and evidence-backed.
Key Responsibilities:
Functional & experience validation:
- Build automated end-to-end test suites (Playwright or Cypress) covering critical user flows
- Build visual-regression testing into the pipeline (screenshot diffing against approved baselines)
- Build automated accessibility test suites (WCAG 2.1/2.2 AA conformance checks)
- Convert every experience-spec acceptance criterion into an executable check; flag criteria that cannot be automated and require manual review — this is a real skill, not a formality: a spec clause like "feels responsive" needs to become a measurable threshold (e.g., time-to-first-token, time-to-interactive) before it's testable
AI/agentic-specific validation:
- Build automated checks for agentic UI states defined by the Experience spec streaming/incremental rendering correctness, progress-indicator accuracy during multi-step agent tasks, correct rendering of failure/retry/escalation states
- Build and run automated red-team regression suites (using tools defined by/coordinated with the Compliance role) so that known jailbreak/injection/PII-leakage test cases are re-run on every release, not just at initial audit
- Automate LLM output evaluation checks — factual consistency, refusal-behavior conformance, format/schema conformance — as repeatable pipeline gates rather than one-off manual review
Operations:
- Run the harness against CTO org del
📌 AI Product Experience Harness (Noida)
🏢 HCLTech
📍 Noida