Job Title: ETL Tester / Data Quality Engineer

Experience: 2 – 4 Years

Location: Chennai

Employment Type: Full-Time

About the Role

We are seeking a detail-oriented ETL Tester to join our data engineering team. In this role, you will be responsible for validating data pipelines, ensuring data integrity across our Medallion Architecture, and automating data quality checks using modern cloud technologies. You will work closely with Data Engineers, BI Developers, and Business Analysts to ensure that our data products are accurate, reliable, and ready for decision-making.

Key Responsibilities

- Data Validation & Testing: Perform end-to-end testing of ETL/ELT pipelines to ensure data completeness, accuracy, and transformation logic.
- SQL & Databricks: Write complex SQL queries and utilize Databricks SQL to validate data transformations across Bronze, Silver, and Gold layers (Medallion Architecture).
- Automation: Develop and maintain automated test scripts using Python and PySpark to validate large datasets efficiently.
- Big Data Testing: Validate data stored in Databricks and Delta Lake, ensuring schema evolution and ACID compliance are handled correctly.
- BI Report Validation: Validate data in Power BI or Qlik reports against the underlying data warehouse to ensure metric accuracy.
- Collaboration:



Work with data engineers to troubleshoot pipeline failures and identify root causes of data discrepancies.
- Documentation: Create and maintain test cases, test plans, and data quality metrics documentation.

Required Technical Skills

- SQL (Mandatory): Robust proficiency in writing complex SQL queries (joins, subqueries, window functions) for data validation.
- Databricks SQL: Hands-on experience querying and validating data within the Databricks environment.
- Python: Experience using Python (Pandas, PyTest, or similar) for data validation and test automation.
- PySpark (Basic): Ability to read and write basic PySpark scripts to validate data at scale.
- Databricks / Delta Lake: Familiarity with the Databricks ecosystem and Delta Lake table format.
- Medallion Architecture: Understanding of the Bronze/Silver/Gold data modeling approach.
- ETL/ELT Concepts: Solid understanding of data warehousing concepts, source-to-target mapping (STM), and data lineage.
- BI Tools: Experience validating reports in Power BI or Qlik (depending on the specific project assignment).

Preferred Qualifications

- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Experience with version control systems (Git).
- Knowledge of Agile/Scrum methodologies.
- Strong analytical and problem-solving skills.

📌 ETL Tester (Chennai)
🏢 Talentgigs
📍 Chennai