Job Title ETL Automation Tester Databricks PySpark Delta Lake Job Summary We re looking for an experienced Data Pipeline Test Engineer to join our team The successful candidate will have strong expertise in Databricks PySpark Delta Lake and ETL testing with a focus on automation and data integrity You ll design develop and execute test plans for data pipelines ensuring data accuracy completeness and integrity at every stage Key Responsibilities Design develop and execute test plans for data pipelines using Databricks PySpark and Delta Lake Validate data accuracy completeness and integrity at every stage of the pipeline Develop and maintain automated test frameworks and scripts using Python and SQL Collaborate with data engineers and analysts to identify testing requirements and ensure data quality Troubleshoot and debug issues with data pipelines and testing frameworks Stay up to date with new technologies and features in Databricks PySpark and Delta Lake Required Skills Strong SQL skills window functions joins aggregates Proficiency in PySpark Data Frame APIs UDFs Structured Streaming Delta Lake fundamentals ACID time travel schema enforcement evolution Change Data Capture CDC Databricks Lakehouse concepts medallion architecture Bronze Silver Gold Photon serverless vs classic clusters Hands-on experience with Databricks platform including notebooks Jobs and DLT pipelines Extensive experience with ETL Extract Transform Load and ELT processes Test automation experience with Python and SQL Strong analytical and problem-solving skills Excellent communication and collaboration skills Preferred to Have Experience with data warehousing and big data technologies Familiarity with Agile development methodologies Knowledge of data governance and data quality frameworks What We Offer Market-competitive salary and benefits package Opportunity to work with cutting-edge technologies and innovative teams Collaborative and dynamic work environment Professional growth and development opportunities Job Types Full-time Permanent Pay 986 410 82 - 1 221 868 47 per year Benefits Flexible schedule Leave encashment Paid sick time Paid time off Provident Fund Work from home Work Location Remote

📌 Senior Etl Developer (India)
🏢 Important Business
📍 India