04 Nov
|
Coforge
|
Hyderabad
We are looking for a highly skilled Data Quality Engineer with strong expertise in ETL Testing, Snowflake, AWS, SQL, and Python to support large-scale data replication and validation initiatives. The ideal candidate will be responsible for validating data pipelines, CDC processes, replication workflows, and ensuring data accuracy across multiple platforms and environments.
Location:
Hyderabad
Experience:
5+
Key Responsibilities
• Validate end-to-end data replication and data integration workflows using Fivetran HVR and related replication technologies.
• Perform source-to-target validation across Snowflake, PostgreSQL, Kafka, and Amazon S3 platforms.
• Execute data reconciliation, completeness checks, record count validation, and SQL-based data quality testing.
• Validate CDC (Change Data Capture) processes and scheduled batch-refresh workflows.
• Develop and maintain SQL and Python-based automation scripts for data validation and regression testing.
• Validate Airflow DAGs, workflow schedules, dependencies, triggers, and execution outcomes.
• Perform ETL testing, batch validation, dependency testing, and defect analysis.
• Investigate data discrepancies, workflow failures, orchestration issues, and quality defects.
• Monitor application and data pipeline health using observability tools such as Dynatrace.
• Support production deployments and post-implementation data validation activities.
• Collaborate with Data Engineers, Database Teams, Application Teams, and QA stakeholders to ensure successful delivery. Required Skills
• Solid experience in ETL Testing / Data Quality Engineering
• Hands-on experience with Snowflake
• Strong knowledge of AWS Cloud Services
• Advanced SQL skills for reconciliation and source-to-target validation
• Python scripting and automation experience
• Experience with Airflow and AWS Glue
• Knowledge of CDC (Change Data Capture) concepts
• Experience in data validation, data reconciliation, and regression testing
• Understanding of data replication and performance testing concepts
• Exposure to Kafka, PostgreSQL, and Amazon S3
• Experience with monitoring tools such as Dynatrace Preferred Skills
• Experience with Fivetran HVR and Fivetran connectors
• Exposure to data warehouse and cloud migration projects
• Experience working in Agile environments What We're Looking For
• Strong analytical and troubleshooting skills
• Ability to work across production and non-production environments
• Excellent communication and stakeholder management skills
• Experience driving quality validation for enterprise-scale data platforms
📌 Quality Engineer (Hyderabad)
🏢 Coforge
📍 Hyderabad