Job Summary

We are looking for an experienced Data Test Engineer / ETL Test Lead with strong expertise in data validation, ETL/ELT testing, and modern cloud data platforms. The ideal candidate will have hands-on experience in testing data pipelines, semi-structured data, and lakehouse architectures, along with strong SQL and automation skills. Experience in Databricks, Snowflake, and Azure Cloud is highly desirable. The role requires collaboration with cross-functional teams to ensure data accuracy, integrity, and performance across enterprise-scale data platforms in an Agile environment.

Key Responsibilities

- Design, develop, and execute test strategies for ETL/ELT and data pipeline testing
- Validate data across source and target systems ensuring accuracy, completeness, and consistency
- Perform data reconciliation and data quality checks for large-scale datasets
- Test and validate semi-structured data formats including JSON, CSV, Parquet, and Avro
- Perform data transformations and validations using PySpark/Python
- Create and execute test cases for Databricks notebooks, jobs, and workflows
- Validate data in Snowflake, Azure Data Lake Storage (ADLS/ADLS Gen2) environments
- Work with Spark SQL and SQL queries for complex data validation scenarios
- Develop reusable validation frameworks and automation scripts using BDD (Cucumber)
- Execute API testing where required for data ingestion pipelines
- Participate in Agile ceremonies including sprint planning, daily stand-ups, and retrospectives
- Collaborate with data engineers, developers, and business analysts to ensure high data quality
- Manage defects using JIRA and maintain documentation in Confluence

Technical Skills

Must Have





- Strong experience in Data Testing / ETL Testing / Data Quality Engineering
- Advanced SQL skills (CTE, window functions, joins, subqueries, aggregations)
- Hands-on experience with Snowflake
- Experience in Databricks (notebooks, jobs, Spark SQL)
- Strong knowledge of PySpark / Python for data validation
- Experience handling semi-structured data (JSON, Parquet, Avro, CSV)
- Robust understanding of data reconciliation processes
- Experience in Agile methodology and tools (JIRA, Confluence)
- Knowledge of BDD framework (Cucumber) and automation concepts

Good to Have

- Experience with Azure Cloud Platform (ADLS, ADLS Gen2)
- Knowledge of GitHub and branching strategies
- Exposure to API testing tools like Postman
- Experience in test automation frameworks (Selenium / Java is a plus)
- Understanding of CI/CD pipelines (Jenkins or similar tools)

Domain Experience

- Banking, Financial Services, Insurance, or Utilities domain experience preferred

Soft Skills

- Strong analytical and problem-solving abilities
- Excellent communication and stakeholder management skills
- Ability to work independently in a fast-paced environment
- Strong attention to detail and commitment to data quality
- Leadership experience preferred for senior/lead roles

Experience Required

- 5-10+ years of experience in QA / Data Testing / ETL Testing
- Experience leading or mentoring QA/data testing teams is a plus

Education

- Bachelor s degree in Computer Science, Engineering, or related field

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 ETL Test Lead (Kolkata)
🏢 FlairDeck
📍 Kolkata