20 Aug
|
PARKAR GLOBAL TECHNOLOGIES
|
Pune
20 Aug
PARKAR GLOBAL TECHNOLOGIES
Pune
Databricks Data Engineer - Pune, India
We are seeking a Databricks Data Engineer to join our growing data engineering team in Pune, India, supporting a structured enterprise BI modernization program. This role will play a key part in the systematic transformation of a complex, enterprise-grade Microsoft SQL Server ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture.
The ideal candidate brings strong hands-on experience with Databricks data engineering capabilities and will work within defined migration frameworks to modernize ETL pipelines, semantic models, and reporting assets into reusable, Spark-based solutions. While exposure to Databricks AI/ML capabilities is a plus, the primary focus of this role is building scalable, reliable data pipelines and analytics workloads aligned with Lakehouse best practices.
Key Responsibilities
- Design, build, and optimize scalable data pipelines using Databricks (Spark, Delta Lake, Unity Catalog).
- Participate in the migration of a ~20TB on-prem Microsoft SQL Server data warehouse to Databricks under defined architectural standards.
- Convert hundreds of SQL Server tables and thousands of SSIS workflows into standardized, reusable Spark-based pipeline patterns.
- Re-engineer legacy SSIS ETL processes into Databricks notebooks, workflows, and orchestration frameworks aligned with Medallion architecture principles.
- Support modernization of SSAS cube-based analytics into Lakehouse-native semantic models and assist in transitioning legacy SSRS reporting to up-to-date governed reporting layers.
- Rebuild and optimize dimensional models within Delta Lake to support scalable analytics workloads.
- Implement data quality, validation, reconciliation, audit, and migration controls throughout the modernization process.
- Optimize Spark performance, partitioning strategies, and cost efficiency across large-scale datasets.
- Apply governance, security, lineage, and access-control standards using Unity Ca
📌 Databricks Data Engineer (Pune)
🏢 PARKAR GLOBAL TECHNOLOGIES
📍 Pune