21 Aug
|
PARKAR GLOBAL TECHNOLOGIES
|
Pune
21 Aug
PARKAR GLOBAL TECHNOLOGIES
Pune
Senior Databricks Data Engineer - Pune, India
We are seeking a Senior Databricks Data Engineer to provide technical leadership for a large-scale enterprise BI modernization initiative. This is not a lift-and-shift migration effort. The role will lead the systematic transformation of a complex Microsoft BI ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture.
The Senior Engineer will establish architectural standards, define repeatable migration frameworks, , and guide the modernization of thousands of legacy data assets into reusable, high-performance Spark-based solutions. This individual combines deep hands-on data engineering expertise with architectural thinking, mentorship capability, and robust cross-functional collaboration skills.
Key Responsibilities
Lead the architecture and implementation of enterprise-scale data pipelines on Databricks.
Serve as technical lead for the migration of a ~20TB Microsoft SQL Server data warehouse to the Databricks Lakehouse Platform.
Design and implement reusable Spark-based pipeline frameworks to replace thousands of SSIS workflows.
Deconstruct SSAS cube logic and redesign it into Lakehouse-native semantic models.
Replace legacy SSRS reporting ecosystems with up-to-date, governed analytics layers.
Rebuild dimensional models within Delta Lake using scalable Lakehouse design patterns.
Define data modeling standards, ingestion frameworks, CI/CD processes, and operational best practices.
Implement and enforce Medallion architecture standards (Bronze/Silver/Gold) with performance optimization and governance controls.
Optimize Spark workloads for scalability, reliability, and cost efficiency.
Implement governance, lineage, security, and monitoring using Unity Catalog and related platform tooling.
Mentor engineers, conduct architectural reviews, establish and maintain engineering standards.
Partner with BI, analytics, and AI/ML teams to enable advanced analytics and downstream
📌 Senior Databricks Data Engineer Pune
🏢 PARKAR GLOBAL TECHNOLOGIES
📍 Pune