We are seeking 6-8 years of experienced Senior Data Engineer – Databricks to design, develop, and optimize scalable data platforms using the Databricks Lakehouse architecture. The ideal candidate will have deep expertise in building modern data pipelines, implementing Delta Lake best practices, and leveraging the latest Databricks capabilities including Auto Loader, Spark Declarative Pipelines (SDP/DLT), Databricks Workflows, Unity Catalog, and AI/BI features.

Key Responsibilities

- Strong proficiency in PySpark and SQL for large-scale data processing.
- Practical experience with Delta Lake / Delta Tables (ACID transactions, schema enforcement, versioning).
- Experience building ingestion pipelines with Auto Loader (cloudFiles, schema inference/evolution).




- Hands-on experience with SDP (Spark Declarative Pipelines / DLT) for building declarative data pipelines.
- Experience orchestrating pipelines with Databricks Workflows (jobs, tasks, triggers).
- Solid understanding of Unity Catalog for governance, permissions, and metastore management.
- Positive grasp of data warehouse concepts — dimensional modeling, data marts, slowly changing dimensions.
- Experience building or supporting AI/BI dashboards (Databricks SQL Dashboards, Genie, or similar BI tools).
- Familiarity with cloud platforms (Azure/AWS/GCP) and cloud storage integration

📌 Databricks Engineer (Pune)
🏢 Talentmatics
📍 Pune