16 Sep
|
Bridge AI
|
India
Job Description
We are hiring a senior Quality Engineering leader who owns end-to-end quality, release sign-off, and automation strategy across our platform — including AI agents, web applications, APIs, and databases .
n
This role blends:
n
n
- Quality Ownership
n
- Automation & Agentic Testing Leadership
n
- Release & Go-Live Authority
n
- Product-aligned execution (PO-style ownership)
n
n
You will start by establishing strong manual and exploratory testing foundations , then systematically drive automation-first quality , including AI agent validation, critic agents, eval frameworks, and safety guardrails .
n
This is not a passive QA role.
n
You are accountable for production quality .
n
Key Responsibilities
n
End-to-End Quality Ownership & Release Sign-Off
n
n
- Own quality outcomes across the full delivery lifecycle
n
- Act as release authority , driving go/no-go decisions
n
- Define and enforce quality gates across features, agents, and releases
n
- Partner with Product and Engineering to balance speed and quality
n
- Reduce production defects through proactive automation and validation
n
n
Automation-First Quality Strategy
n
n
- Define and own the automation roadmap (UI, API, DB, agentic systems)
n
- Build and maintain hybrid automation frameworks using Python
n
- Drive CI/CD-integrated automated testing pipelines
n
- Ensure automation coverage continuously replaces repetitive manual testing
n
- Guide aligned Quality Engineers in automation implementation
n
n
Agentic AI & LLM Quality Engineering
n
n
- Own quality for AI agents, tool calls, and multi-step workflows
n
- Validate:
n
- Agent behavior & reasoning paths
n
- Tool invocation correctness
n
- Hallucinations & unsafe outputs
n
- RAG accuracy and grounding
n
- Define and execute agent evaluation (evals) frameworks
n
- Collaborate with Critic Engineers to design:
n
- Critic agents
n
- Automated agent validation
n
- Benchmark datasets & scoring rubrics
n
- Lead innovation in agent testing methodologies
n
n
Manual, Exploratory & Scenario-Based Testing
n
n
- Drive high-quality manual and exploratory testing where automation is not yet viable
n
- Design test scenarios covering edge cases, failure modes, and real-world flows
n
- Ensure strong test data strategies and defect lifecycle management
n
- Use manual testing strategically — not as a long-term crutch
n
n
Product-Aligned Ownership
n
n
- Work as a quality-focused Product Owner partner
n
- Align closely with Product Managers on acceptance criteria and readiness
n
- Participate in sprint planning, refinement, and release discussions
n
- Ensure quality is embedded into feature design, not added later
n
n
Cross-Team Collaboration
n
n
- Work closely with:
n
- Product
n
- Engineering
n
- Agentic Ops
n
- RAG & AI teams
n
- Act as the single quality voice across delivery discussions
n
- Mentor and guide aligned Quality Engineers and contributors
n
n
Required Skills & Experience
n
Quality & Manual Testing
n
n
- 5+ years of strong hands-on experience in manual and exploratory testing
n
- Deep understanding of SDLC/STLC, test planning, traceability, and defect management
n
- Solid API testing experience (Postman, REST clients)
n
n
Automation (UI, API, Database)
n
n
- Strong experience in:
n
- UI automation (Playwright / Selenium / Cypress)
n
- API automation (pytest, requests, REST Assured)
n
- Database validation using SQL
n
- Experience designing end-to-end automation frameworks
n
- CI/CD integration (Git Hub Actions, Git Lab, Jenkins)
n
n
Agentic AI & LLM Testing
n
n
- Hands-on experience testing LLMs and AI agents
n
- Understanding of:
n
- Agent workflows
n
- Tool calling
n
- RAG pipelines
n
- Guardrails & safety validation
n
- Experience designing or executing eval frameworks
n
n
Python, MCP & Cloud
n
n
- Strong Python skills for automation, utilities, and validation
n
- Understanding of MCP servers, agent tools, and orchestration
n
- Cloud exposure (GCP / AWS / Azure) in QA or automation contexts
n
n
What Success Looks Like
n
n
- Releases go out predictably and confidently
n
- Automation coverage grows sprint after sprint
n
- Agent failures are caught before production
n
- Quality becomes a shared responsibility , led by you
n
- Manual testing effort reduces as automation and agent critics mature
n
n
Why This Role Is Special
n
n
- Owns release sign-off
n
- Drives automation-first quality
n
- Shapes how agentic AI is tested
n
- Works closely with Product & CTO
n
- Leads innovation in AI testing
n
- Not a test executor role
n
- Not a checkbox QA position
n
n
📌 Product-Aligned Agentic Quality Engineering Lead (Automation & Agentic AI) (India)
🏢 Bridge AI
📍 India