09 Sep
|
Vialto Partners
|
Bengaluru
09 Sep
Vialto Partners
Bengaluru
About Vialto Labs (VLabs)
Vialto Labs (VLabs) is responsible for redesigning how work is delivered in the
tax and immigration service lines, as well as driving operational efficiency
across Vialto’s functional areas using AI. The team builds and deploys novel
AI-enabled solutions that directly improve productivity and increase delivery
quality for our clients. VLabs is accountable for rapidly turning innovative
experiments into production-ready deliverables at scale and embedding them into
day-to-day operations. This team focuses on the highest-impact workflows,
creating standardized, repeatable capabilities that can be deployed globally.
Operating with a mandate for speed and measurable outcomes, VLabs works
alongside service line, product, and platform leaders.
About the Role
AI Test Engineering is a hands-on role within VLabs Quality Engineering,
responsible for validating the performance, reliability, and integrity of
AI-enabled solutions in production environments. This role operates at the
intersection of AI engineering and quality assurance,
ensuring that outputs from
LLMs, OCR pipelines, document classification models, and agentic workflows
perform as expected at scale and meet defined business performance
thresholds. Working closely with the Programme Test Manager and partnering with
engineering, product, and delivery teams, this role translates AI testing
strategy into executable frameworks, evaluation pipelines, and reusable assets
embedded into the delivery lifecycle.
Success requires independent execution, solid technical depth, and the ability
to proactively identify risks, patterns, and performance gaps while enabling
rapid, production-grade deployment of AI capabilities.
Key Responsibilities
AI Evaluation & Test Design
* Translate AI testing strategy into executable test scenarios across LLM
outputs, document classification, extraction accuracy, agent workflows, and
edge cases
* Design adversarial and boundary test inputs to expose hallucina
📌 AI Test Engineer (Bengaluru)
🏢 Vialto Partners
📍 Bengaluru