20 Aug
|
PARKAR GLOBAL TECHNOLOGIES
|
Pune
20 Aug
PARKAR GLOBAL TECHNOLOGIES
Pune
Senior Databricks Data Engineer - Pune, India
We are seeking a Senior Databricks Data Engineer to provide technical leadership for a large-scale enterprise BI modernization initiative. This is not a lift-and-shift migration effort. The role will lead the systematic transformation of a complex Microsoft BI ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture.
The Senior Engineer will establish architectural standards, define repeatable migration frameworks, , and guide the modernization of thousands of legacy data assets into reusable, high-performance Spark-based solutions. This individual combines deep hands-on data engineering expertise with architectural thinking, mentorship capability, and strong cross-functional collaboration skills.
Key Responsibilities
- Lead the architecture and implementation of enterprise-scale data pipelines on Databricks.
- Serve as technical lead for the migration of a ~20TB Microsoft SQL Server data warehouse to the Databricks Lakehouse Platform.
- Design and implement reusable Spark-based pipeline frameworks to replace thousands of SSIS workflows.
- Deconstruct SSAS cube logic and redesign it into Lakehouse-native semantic models.
- Replace legacy SSRS reporting ecosystems with up-to-date, governed analytics layers.
- Rebuild dimensional models within Delta Lake using scalable Lakehouse design patterns.
- Define data modeling standards, ingestion frameworks, CI/CD processes, and operational best practices.
- Implement and enforce Medallion architecture standards (Bronze/Silver/Gold) with performance optimization and governance controls.
- Optimize Spark workloads for scalability, reliability, and cost efficiency.
- Implement governance, lineage, security, and monitoring using Unity Catalog and related platform tooling.
- Mentor engineers, conduct architectural reviews, establish and maintain engineering standards.
- Partner with BI, analytics, and AI/ML teams to enable advanced analytics and downstream
📌 Senior Databricks Data Engineer (Pune)
🏢 PARKAR GLOBAL TECHNOLOGIES
📍 Pune