Grade:

Position Name: Senior Engineer - Testing

Company overview

Get to Know the Opportunity

A highly skilled Quality Engineer specializing in data and ETL testing within modern cloud-based data platforms, with solid expertise in Databricks, PySpark, Python, and advanced SQL (Spark SQL). The role focuses on ensuring the accuracy, integrity, and reliability of large-scale data pipelines through comprehensive validation, automation, and performance optimization.
This position is responsible for end-to-end testing of ETL/ELT pipelines, including source-to-target validation, data reconciliation, and data quality assurance across complex data ecosystems.

The Contributions You Will Make

• 5+ years of experience in Data/ETL testing using Databricks, PySpark, and Python with strong automation exposure
• Strong expertise in Advanced SQL (Spark SQL) for data validation, reconciliation, and performance tuning
• Hands-on experience in end-to-end testing of ETL/ELT pipelines implemented using PySpark and Delta Lake
• Experience in building/using data validation frameworks (PySpark, Python,



/automation frameworks)
• Ensure source data quality by validating accuracy, completeness, null values, duplicates, and consistency before ingestion into Databricks pipelines to prevent downstream data issues
• Solid knowledge of STLC, test planning, estimation, and data testing strategies
• Strong capability in source-to-target validation, data quality checks, and large-scale data analysis
• Working knowledge of Databricks architecture (clusters, notebooks, jobs) and cloud ecosystem (ADLS, ADF, Snowflake basics)
• Experience in data migration testing (DB2/Oracle to Databricks) and reconciliation strategies
• Good understanding of PySpark transformations, joins, aggregations, and performance optimization techniques
• Exposure to MDM testing and modernized data platforms is an added advantage
• Strong communication skills with ability to analyze business requirements and work in Agile en

📌 Senior Engineer (India)
🏢 Voya Financial
📍 India