20 Aug
|
Birlasoft
|
Hinjawadi
20 Aug
Birlasoft
Hinjawadi
Country/Region: IN
Requisition ID: 38599
Work Model:
Position Type:
Salary Range:
Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI
Title: Databricks - Technical Specialist-Data Engg
Description:
Area(s) of responsibility
Role Summary
We are looking for a highly skilled Databricks Data Engineer with solid hands on expertise in Databricks, PySpark, ADF, and SQL. The candidate will be responsible for architecting, developing, and optimizing contemporary data platforms and analytical solutions on Azure. The role requires robust experience building enterprise-grade data pipelines, enabling ingestion from diverse sources, implementing complex transformations, and supporting scalable analytics initiatives.
Key Responsibilities
Data Engineering Execution
Build and maintain ingestion frameworks (ADF / Databricks / Spark)
Implement Bronze -> Silver transformations aligned to architecture
Architect data quality checks, schema validation, and contract rules
Build and optimize robust, high-throughput ELT/ETL pipelines, enabling ingestion, transformation,
and curation of structured, semi structured, and unstructured data.
Integrate data from multiple on premise and cloud based systems, APIs, and third-party sources.
Implement complex transformations using PySpark, ensuring performance efficiency and code modularity.
Build orchestration workflows in ADF, including pipelines, triggers, linked services, integration runtimes, and parameterized datasets.
Familiar with using Databicks Genie.
2.Design and implement curated data models in Gold layer aligned to business use cases
Build:
Dimensional models (star/snowflake schemas)
Fact tables, dimensions, surrogate keys, SCD handling
Translate Silver datasets into:
Analytics-ready models
Consistent KPI definitions and business logic
Ensure:
Consistency across domains (common dimensions, conformed models)
Reusability and scalability of models
Databricks & PySpark Engineering
Develop scalable transf
📌 Databricks Technical Specialist Data Engg Hinjawadi
🏢 Birlasoft
📍 Hinjawadi