Area(s) of responsibility
Role SummaryWe are looking for a highly skilled Databricks Data Engineer with strong hands on expertise in Databricks, PySpark, ADF, and SQL. The candidate will be responsible for architecting, developing, and optimizing up-to-date data platforms and analytical solutions on Azure. The role requires strong experience building enterprise-grade data pipelines, enabling ingestion from diverse sources, implementing complex transformations, and supporting scalable analytics initiatives.
Key Responsibilities1. Data Engineering Execution
- Build and maintain ingestion frameworks (ADF / Databricks / Spark)Implement Bronze -> Silver transformations aligned to architectureArchitect data quality checks, schema validation, and contract rules- Build and optimize robust, high-throughput ELT/ETL pipelines, enabling ingestion, transformation, and curation of structured, semi structured, and unstructured data.- Integrate data from multiple on premise and cloud based systems, APIs, and third-party sources.- Implement complex transformations using PySpark,



ensuring performance efficiency and code modularity.- Build orchestration workflows in ADF, including pipelines, triggers, linked services, integration runtimes, and parameterized datasets.- Familiar with using Databicks Genie.
2.Design and implement curated data models in Gold layer aligned to business use casesBuild:-Dimensional models (star/snowflake schemas)-Fact tables, dimensions, surrogate keys, SCD handlingTranslate Silver datasets into:-Analytics-ready models-Consistent KPI definitions and business logicEnsure:-Consistency across domains (common dimensions, conformed models)-Reusability and scalability of models2. Databricks & PySpark EngineeringDevelop scalable transformation scripts using PySpark on Databricks, applying advanced optimizations like caching, partitioning, and Delta Lake capabilities.Implement Delta Lake features—ACID transactions, schema enforcement, schema evolution, and time travel—ac

📌 Databricks - Technical Specialist-Data Engg (Pune)
🏢 Birlasoft
📍 Pune