17 Nov
|
Pearson
|
Chennai
Job Description: Quality Assurance Engineer III– ETL & Data Test Automation
Role Overview
We are looking for a hands-on Quality Engineering Engineer with strong expertise in ETL/Data Testing Automation and working knowledge of API Automation . The primary responsibility is to build scalable automated validation solutions for data pipelines, data transformations, and cloud-based data platforms.
Key Responsibilities
- Design, develop, and maintain Python and SQL-based ETL/Data Testing Automation frameworks .
- Automate source-to-target validation across complex ETL/ELT data pipelines.
- Validate data across Bronze/Raw, Silver/Curated, and Gold/Consumption layers .
- ETL & Data Validation: Validate source-to-target data, transformations, schema, record counts, nulls, duplicates, and business rules using BigQuery and SQL .
- Automation: Develop Python/dbt-based automation for ETL validation, data-quality checks, regression testing, and automated test reporting.
- GCP: Validate end-to-end data pipelines across BigQuery, GCS, Dataflow, Pub/Sub, and Cloud Composer , including full and incremental data loads.
- Build reusable automation for:
- Source-to-target reconciliation
- Row-count and aggregate validation
- Schema and data-type validation
- Null, duplicate, and mandatory-field checks
- Data completeness and integrity checks
- Transformation and business-rule validation
- Incremental, delta, and historical load validation
- Data freshness and pipeline validation
- Develop solutions for validating high-volume datasets using Python, SQL, Pandas, and cloud data platforms.
- Perform complex SQL validation and troubleshoot data discrepancies across source and target systems.
- Validate structured and semi-structured data, including JSON and nested datasets .
- Develop reusable, configuration-driven or metadata-driven automation components to reduce manual testing.
- Integrate automated ETL/data-quality test suites with CI/CD pipelines such as Jenkins, GitHub Actions, or Azure DevOps.
- Perform defect investigation and root-cause analysis by collaborating with developers, data engineers, and business teams.
- Maintain automation code using Git/GitHub , including appropriate branching and pull-request practices.
- Support API validation as a secondary responsibility , including REST API request/response, status code, JSON payload, authentication, schema, and basic integration validation.
- Develop and maintain basic API automation using Python Requests/Pytest, Postman/Newman, or REST Assured when required.
- Contribute to test strategy, regression coverage, release readiness, and overall quality engineering practices.
Who we are:
At Pearson, our purpose is simple: to help people realize the life they imagine through learning. We believe that every learning opportunity is a chance for a personal breakthrough. We are the world's lifelong learning company. For us, learning isn't just what we do. It's who we are. To learn more: We are Pearson.
Pearson is an Equal Prospect Employer and a member of E-Verify. Employment decisions are based on qualifications, merit and business need. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, gender expression, age, national origin, protected veteran status, disability status or any other group protected by law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.
If you are an individual with a disability and are unable or limited in your ability to use or access our career site as a result of your disability, you may request reasonable accommodations by emailing [HIDDEN TEXT].
Job: Engineering
Job Family: TECHNOLOGY
Organization: OCTO
Schedule: FULL_TIME
Workplace Type: Hybrid
Req ID: 26592
📌 Quality Assurance Engineer III ETL & Data Test Automation (Chennai)
🏢 Pearson
📍 Chennai