Role Summary

Own test automation strategy and execution across the organization's platform — including AI-powered features, Salesforce workflows, and ERP integrations — ensuring releases are reliable and regressions are caught before production.

Key Responsibilities

- Design and build automated test suites (UI, API, integration) for platform, Salesforce, and AI features

- Design and run beta and A/B test programs to validate feature quality and rollout risk before general release

- Set up and maintain CI/CD-integrated test pipelines, introducing new testing approaches (contract testing, canary/progressive rollout gating, synthetic monitoring) as the pipeline matures

- Build and maintain Python-driven unit and integration test frameworks across services

- Define QA processes, test plans, and coverage strategy with engineering

- Perform manual exploratory testing where automation isn't yet in place

- Design test/eval sets for AI features (prompt/response validation, regression on model outputs)

- Track and report defects, working with engineers to resolution

- Continuously improve test reliability and reduce flaky tests

Tech Stack

- Automation frameworks: Playwright, Cypress, or Selenium

- Python testing frameworks: pytest, unittest (unit + integration test authoring, mandatory)

- API testing: Postman/Newman, REST-assured

- CI/CD: GitHub Actions or Azure DevOps, with feature-flag/A-B-testing tooling (LaunchDarkly or Azure App Configuration feature flags)

- Scripting: Python (primary), JavaScript/TypeScript

- Salesforce testing: Provar or equivalent (nice to have)

- AI eval tooling exposure: PromptFoo or custom eval scripts

Cutting-Edge AI Skills

- Designing test cases and eval sets for LLM-powered features (accuracy, hallucination, safety checks)





- Basic prompt/response comparison and regression testing for AI outputs

- Understanding of non-deterministic system testing strategies

Business Domain Exposure

- The organization is a large-scale master real estate developer delivering mixed-use residential, commercial, and hospitality communities across multiple master-planned developments, alongside affiliated retail, wellness/fitness, food & beverage, hospitality, education, and property-management operating brands.

- Testing sales/CRM workflows (Salesforce) tied to real-estate booking and payment processes

- Validating AI-assisted features used by sales and buyer-facing teams

- Regression testing across ERP-integrated finance/procurement workflows

Must-Have Requirements

- Mandatory: hands-on beta testing and A/B testing experience (test design, rollout gating, results analysis)

- Mandatory: experience introducing current testing approaches within a CI/CD pipeline (beyond basic pipeline test-running)

- Mandatory: Python-driven unit and integration testing framework experience (pytest/unittest)

- Hands-on experience with automation frameworks (Playwright, Cypress, Selenium, or similar)

- API testing experience (Postman, REST-assured, or similar)

- Experience integrating automated tests into CI/CD pipelines

- Strong understanding of QA methodology and defect lifecycle

Nice to Have

- Performance/load testing experience

- Experience testing AI-powered features (prompt/response validation)

- ISTQB or equivalent QA certification

Pay: ₹85,000.00 - ₹200,000.00 per month

Experience

- QA/test automation: 7 years (Preferred)

- beta/A/B testing : 7 years (Preferred)

- Python-driven unit & integration test frameworks: 7 years (Preferred)

Work Location: In person

📌 QA Automation Engineer (Kochi)
🏢 Unisonal Accounting Solutions
📍 Kochi