Grade:

Position Name: Senior Engineer - Testing

Company overview

Get to Know the Opportunity

A highly skilled Quality Engineer specializing in data and ETL testing within modern cloud-based data platforms, with strong expertise in Databricks, PySpark, Python, and advanced SQL (Spark SQL). The role focuses on ensuring the accuracy, integrity, and reliability of large-scale data pipelines through comprehensive validation, automation, and performance optimization.

This position is responsible for end-to-end testing of ETL/ELT pipelines, including source-to-target validation, data reconciliation, and data quality assurance across complex data ecosystems.

The Contributions You Will Make

- 5+ years of experience in Data/ETL testing using Databricks, PySpark, and Python with strong automation exposure
- Strong expertise in Advanced SQL (Spark SQL) for data validation, reconciliation, and performance tuning
- Hands-on experience in end-to-end testing of ETL/ELT pipelines implemented using PySpark and Delta Lake
- Experience in building/using data validation frameworks (PySpark, Python, /automation frameworks)
- Ensure source data quality by validating accuracy, completeness,



null values, duplicates, and consistency before ingestion into Databricks pipelines to prevent downstream data issues
- Solid knowledge of STLC, test planning, estimation, and data testing strategies
- Solid capability in source-to-target validation, data quality checks, and large-scale data analysis
- Working knowledge of Databricks architecture (clusters, notebooks, jobs) and cloud ecosystem (ADLS, ADF, Snowflake basics)
- Experience in data migration testing (DB2/Oracle to Databricks) and reconciliation strategies
- Good understanding of PySpark transformations, joins, aggregations, and performance optimization techniques
- Exposure to MDM testing and modernized data platforms is an added advantage
- Strong communication skills with ability to analyze business requirements and work in Agile environments

Education Qualification

- Bachelor's degree in Computer Science, Engineering, or a related field; Master's Degree preferred

Expected Minimum Knowledge & Experience

Other Required Critical Skills

📌 Senior Engineer - Testing (India)
🏢 Voya Financial
📍 India