We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.
The ideal candidate will have a robust background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.
Responsibilities
- Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
- Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
- Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
- Develop reusable and scalable test automation frameworks using Python and SQL
- Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
- Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
- Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming
Requirements
- 3.5+ years of hands-on experience in Data Quality Engineering
- Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
- Proficiency in SQL for data validation and test automation
- Good knowledge of Python for scripting and framework development
- Experience with one or more Test Automation Frameworks
- Knowledge of Cloud Data Services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), or GCP (BigQuery)
- Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
- Familiarity with Agile/Scrum methodologies with a proven ability to contribute effectively
- English language proficiency at an Upper-Intermediate level (B2) or higher
Nice to have
- Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
- Basic understanding of data governance and metadata management concepts
- Certification in cloud platforms (Azure/AWS/GCP)
📌 Data Quality Engineer (Pune)
🏢 Epam
📍 Pune