Role & responsibilities

We are seeking an experienced and vision-driven Lead ETL Automation Tester to architect, build, and maintain our enterprise Data & ETL Quality Assurance automation framework. In this role, you will lead the end-to-end quality strategy for large-scale data pipelinesfrom test planning and requirement traceability to test execution and automated reporting. The ideal candidate possesses deep expertise in Python, PySpark, Pandas, and Robot Framework, coupled with modern AI-driven development tools like GitHub Copilot to accelerate SQL query generation and schema validation across complex data architectures.

Role Details

- Job Title: Lead ETL Automation Tester
- Employment Type: Full-time
- Location: Hybrid {Bengaluru or Chennai}
- Experience : 7+

Key Responsibilities 1. Framework Architecture & Technical Leadership

- Architect & Enhance Frameworks: Design, build, and maintain scalable, reusable ETL automation test frameworks using Python, PySpark, Pandas, and Robot Framework.
- Data Orchestration: Develop PySpark-based orchestration mechanisms to execute SQL queries and perform high-performance comparisons and validations on large, complex data volumes.
- Data Injection & Feed Handling: Design configurable data injection strategies and validate source feed consumption across varied streaming and batch architectures.
- AI-Assisted Engineering: Leverage GitHub Copilot to auto-generate complex SQL queries directly from data transformation mapping rules, database schemas, and data models.

2. Test Planning, Strategy & Traceability

- End-to-End Test Strategy:



Formulate comprehensive Test Strategies and detailed Test Plans covering baseline testing, regression, data integrity, and performance validation.
- Requirement Traceability: Construct and maintain a robust Requirement Traceability Matrix (RTM) to ensure 100% test coverage across data transformation rules and business logic.
- Test Data Management: Establish robust test data management and synthetic data injection methodologies to simulate production workloads.

3. Reporting, Validation & Quality Assurance

- Advanced Report Validation: Build automated report validation workflows using Pandas alongside Pyodbc, Pandera (data validation/schema enforcement), Pywinauto, and Excel parsing libraries.
- Defect Life Cycle & Execution: Lead test execution cycles, log detailed data defects, collaborate closely with data engineering teams, and deliver accurate execution metrics to stakeholders.
- Mentorship & Process Improvement: Provide technical guidance to QA engineers, champion automation best practices, and continuously refine test processes.

Required Skills & Qualifications

Technical Competencies

- Programming & Scripting: Expert proficiency in Python, including deep familiarity with core libraries (Pandas, Pyodbc, Pandera).
- Big Data & Query Orchestration:



Strong experience with PySpark for querying and validating multi-gigabyte/terabyte-scale datasets.
- Test Automation Frameworks: Proven experience architecting test automation suites using Robot Framework tailored for data and ETL pipelines.
- AI Tooling & Code Generation: Hands-on experience utilizing GitHub Copilot (or similar LLM-driven developer tools) for automated SQL query generation based on source-to-target mapping documents.
- SQL & Data Modeling: Advanced SQL skills with deep knowledge of relational databases, data warehousing concepts, and data transformation logic.
- Reporting & UI/Desktop Automation: Experience with Pywinauto and Python Excel libraries (openpyxl, xlsxwriter) for automated report verification.

Professional Experience & Soft Skills

- Experience: 7+ years in Data / ETL Testing, with at least 3–4years in a technical leadership.
- Testing Lifecycle: Demonstrated mastery of QA methodologies, Test Plan creation, RTM maintenance, execution tracking, and metric reporting.
- Analytical & Problem Solving: Exceptional ability to diagnose complex data discrepancies between source and target systems.
- Communication: Solid communication skills to liaise effectively between business analysts, data architects, and software engineering teams.

Preferred Qualifications

- Experience with Cloud Data Warehouses (e.g., Snowflake, Databricks, BigQuery, AWS Redshift).
- Familiarity with CI/CD integration for test automation suites (e.g., GitHub Actions, Jenkins, Azure DevOps).
- Knowledge of regulatory compliance standards and data governance frameworks.

Preferred candidate profile

📌 ETL automation tester (Bengaluru)
🏢 CGI
📍 Bengaluru