Ensure accuracy reliability and security of enterprise data pipelines through robust SQL-based ETL testing and test automation.
KEY RESPONSIBILITIES
Create test plans for Raw Refined and analytical data processing layers.
Reconcile row counts mappings data values and transformation results using SQL.
Test schema handling merge logic deduplication and repeatable pipeline runs.
Validate PII tokenization access control orchestration and failure scenarios.
Automate data checks and execute integration regression and end-to-end tests.
Support QA/UAT cycles defect tracking evidence capture and release validation.
Requirements
REQUIRED SKILLS
Solid SQL and ETL/data validation testing
Python scripting for test automation
AWS Glue Spark or Databricks testing exposure
Data reconciliation integration and regression testing
Defect management CI/CD and test reporting
PREFERRED EXPERIENCE
Delta Lake Unity Catalog Redshift and regulated-data platform testing
Required Skills:
Robust SQL and ETL/data validation testing Python scripting for test automation AWS Glue Spark or Databricks testing exposure Data reconciliation integration and regression testing Defect management CI/CD and test reporting