AI Quality Assurance Engineer – Intelligent Automation

Role Overview

We are looking for a 5-8 years experienced AI QA Automation Tester to support a financial process automation solution built using Microsoft Power Platform technologies, primarily Power Automate, Power Apps, and Excel-based automation/scripts.

The solution also incorporates AI-based document extraction through APIs and may include Python-based automation components. The QA Tester will be responsible for validating end-to-end automated workflows, ensuring the accuracy and integrity of financial data, identifying automation failures and edge cases, and confirming that system outputs meet defined business requirements.

The role requires close collaboration with developers, business analysts, and finance stakeholders to ensure the automation solution is reliable, accurate, and production-ready.

Key Responsibilities

- Perform functional and end-to-end testing of Power Automate workflows, validating triggers, conditions, business rules, integrations, exception paths, and outputs.
- Test Power Apps functionality, including user inputs, validations, workflow integrations, business rules, and expected application behaviour.
- Validate Excel-based scripts and automated processing, ensuring calculations, transformations, mappings, and generated outputs are accurate.
- Test AI-based document extraction capabilities and validate extracted information against source documents for accuracy, completeness, and consistency.
- Validate API interactions associated with AI/document-processing components, including request/response handling and error scenarios.
- Test Python-based scripts and automation components, where applicable,



to verify functional accuracy and expected outputs.
- Perform data validation and reconciliation across source documents, intermediate processing stages, and final financial outputs.
- Develop and execute test scenarios covering positive, negative, boundary, exception, and edge-case conditions.
- Identify automation breakpoints, data inconsistencies, integration failures, and unexpected workflow behaviour.
- Log and document defects with explicit reproduction steps, expected versus actual results, supporting evidence, and severity.
- Work closely with the development team to investigate issues and retest defect fixes.
- Perform regression testing following workflow, application, script, or AI-model/API changes.
- Validate error handling, notifications, retry mechanisms, exception processing, and recovery scenarios within automated workflows.
- Maintain appropriate test cases, test evidence, defect records, and test execution results.
- Support business/UAT validation and provide QA sign-off recommendations based on testing outcomes.

Key Skills & Experience

Essential

- Strong experience in functional, integration, and end-to-end software testing.
- Experience testing Microsoft Power Automate workflows.
- Good understanding of Microsoft Power Apps and Power Platform-based solutions.




- Strong knowledge of Excel, including formulas, data validation, macros/scripts, and automated data processing.
- Experience validating financial data, calculations, reconciliations, and business rules.
- Strong understanding of test design techniques, defect management, regression testing, and edge-case testing.
- Ability to analyse complex automated workflows and identify logical or data-related failures.
- Strong attention to detail, particularly when validating financial transactions and automated outputs.

Preferred / Good to Have

- Experience testing AI/ML or Generative AI-based solutions, particularly document extraction or intelligent document processing.
- Experience validating AI API outputs against source documents and expected results.
- Knowledge of REST APIs and API testing tools.
- Basic to intermediate knowledge of Python and experience testing Python-based scripts.
- Experience with Microsoft Power Platform integration scenarios.
- Familiarity with test management and defect tracking tools such as Azure DevOps or Jira.
- Experience working on financial process automation, finance transformation, RPA, or intelligent automation projects.

Key Testing Areas The QA Tester will primarily focus on:

1. Power Automate Workflow Testing
2. Power Apps Functional Testing
3. Financial Data Validation & Reconciliation
4. Excel Script / Automation Validation
5. AI Document Extraction Accuracy Testing
6. API & Integration Testing
7. Python Script Validation, where applicable
8. Exception & Error Handling Testing
9. End-to-End Business Process Testing
10. Regression Testing & Defect Retesting

📌 Senior Power Automate Workflow Testing (6+ Years) (India)
🏢 MindBrain
📍 India