08 Oct
|
Accrete
|
Mumbai
About Accrete
Accrete is an agentic managed services company: an AI workforce that does high-stakes, judgement-heavy work for government and enterprise clients — at the economics of software, not labor.
At the core is Accrete’s Knowledge Engine, a agile context graph that captures an organization’s tacit knowledge, resolves data across silos, and builds a living, auditable ground truth. Expert agents reason against that ground truth to act on complex, high-stakes decisions — not just answer questions about them.
From national security to commercial operations, Accrete delivers the work on one platform, with unlimited expert agents and expert judgement.
About the Role:
We are seeking an AI Platform Senior Engineer, QA – Agentic AI & Automation to lead quality assurance for our agent-driven platforms and AI models. This role focuses on validating intelligent agents, non-deterministic AI outputs, and cross-product workflows using advanced automation and AI evaluation techniques.
You will play a key role in building our Enterprise AI Trust & Validation Framework, ensuring reliability,
transparency, and scalability of AI systems.
Key Responsibilities
Agentic AI & System Testing
• Test multi-agent workflows, orchestration layers, and cross-domain intelligence systems
• Validate AI-generated narratives, themes, and analytical outputs.
• Perform groundedness, coherence, hallucination, and stability testing.
• Test conversational AI and chat-based agent systems.
• Evaluate consistency across multiple runs and detect output drift.
Automation & Framework Development
• Design and maintain automation frameworks using Python, JavaScript/TypeScript, Pytest, and Playwright.
• Build E2E automation for UI, APIs, and agent pipelines.
• Develop reusable test utilities for AI validation and regression testing.
• Integrate automation with CI/CD pipelines.
AI Model & Evaluation Testing
• Validate in-house AI/ML models and inference pipelines.
• Implement LLM-as-Judge and s
📌 AI Platform Senior Engineer, QA (Mumbai)
🏢 Accrete
📍 Mumbai