We are looking for an ETL / Data Testing Engineer with robust hands-on experience in DB2, PySpark, Cloudera, SQL, ETL testing, and database validation. The candidate should have experience developing and executing test cases, performing large-scale data comparisons, validating data quality, identifying database/query performance issues, and managing defects.
The role requires close collaboration with Data Engineers, Testers, Business SMEs, and other stakeholders for requirement clarification, data validation, and issue resolution.
Key Responsibilities
- Perform ETL, database, and data validation testing.
- Develop and execute test cases and test plans.
- Validate and compare data between DB2 and Cloudera.
- Write and optimize complex SQL queries/scripts.
- Use PySpark and Python for data validation and automation.
- Perform data quality checks and reconciliation.
- Identify, report, re-test, and track defects.
- Coordinate with Data Engineers, Testers, and Business SMEs for issue resolution.