Ensure accuracy reliability and security of enterprise data pipelines through robust SQL-based ETL testing and test automation.
KEY RESPONSIBILITIES
- Create test plans for Raw Refined and analytical data processing layers.
- Reconcile row counts mappings data values and transformation results using SQL.
- Test schema handling merge logic deduplication and repeatable pipeline runs.
- Validate PII tokenization access control orchestration and failure scenarios.
- Automate data checks and execute integration regression and end-to-end tests.
- Support QA/UAT cycles defect tracking evidence capture and release validation.
Requirements
REQUIRED SKILLS
- Strong SQL and ETL/data validation testing
- Python scripting for test automation
- AWS Glue Spark or Databricks testing exposure
- Data reconciliation integration and regression testing
- Defect management CI/CD and test reporting
PREFERRED EXPERIENCE
Delta Lake Unity Catalog Redshift and regulated-data platform testing
Required Skills:
Strong SQL and ETL/data validation testing Python scripting for test automation AWS Glue Spark or Databricks testing exposure Data reconciliation integration and regression testing Defect management CI/CD and test reporting