08 Nov
|
NIIT Technologies
|
Secunderabad
08 Nov
NIIT Technologies
Secunderabad
We are looking for a highly skilled Data Quality Engineer with strong expertise in ETL Testing, Snowflake, AWS, SQL, and Python to support large-scale data replication and validation initiatives. The ideal candidate will be responsible for validating data pipelines, CDC processes, replication workflows, and ensuring data accuracy across multiple platforms and environments.
Location: Hyderabad
Experience: 5+
Key Responsibilities
Validate end-to-end data replication and data integration workflows using Fivetran HVR and related replication technologies.
Perform source-to-target validation across Snowflake, PostgreSQL, Kafka, and Amazon S3 platforms.
Execute data reconciliation, completeness checks, record count validation, and SQL-based data quality testing.
Validate CDC (Change Data Capture) processes and scheduled batch-refresh workflows.
Develop and maintain SQL and Python-based automation scripts for data validation and regression testing.
Validate Airflow DAGs, workflow schedules, dependencies, triggers, and execution outcomes.
Perform ETL testing, batch validation, dependency testing, and defect analysis.
Investigate data discrepancies, workflow failures, orchestration issues, and quality defects.
Monitor application and data pipeline health using observability tools such as Dynatrace.
Support production deployments and post-implementation data validation activities.
Collaborate with Data Engineers, Database Teams, Application Teams, and QA stakeholders to ensure successful delivery.
Required Skills
Strong experience in ETL Testing / Data Quality Engineering
Hands-on experience with Snowflake
Robust knowledge of AWS Cloud Services
Advanced SQL skills for reconciliation and source-to-target validation
Python scripting and automation experience
Experience with Airflow and AWS Glue
Knowledge of CDC (Change Data Capture) concepts
Experience in data validation, data reconciliation, and regression testing
Understanding of data replication and performance testing concepts
Exposure to Kafka, PostgreSQL, and Amazon S3
Experience with monitoring tools such as Dynatrace
Preferred Skills
Experience with Fivetran HVR and Fivetran connectors
Exposure to data warehouse and cloud migration projects
Experience working in Agile environments
What We're Looking For
Strong analytical and troubleshooting skills
Ability to work across production and non-production environments
Excellent communication and stakeholder management skills
Experience driving quality validation for enterprise-scale data platforms
📌 Quality Testing Engineer (Secunderabad)
🏢 NIIT Technologies
📍 Secunderabad