Position : Senior Databricks Data Engineer

Rel. Experience : 10+ Years

Salary : Nego

Work mode -Hybrid (3 days WFO/week)

Job Location : Pimpri-Chinchwad, Pune

We are seeking a Senior Databricks Data Engineer to provide technical leadership for a large-scale enterprise BI modernization initiative. This is not a lift-and-shift migration effort. The role will lead the systematic transformation of a complex Microsoft BI ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture.

Key Responsibilities

- Lead the architecture and implementation of enterprise-scale data pipelines on Databricks.
- Serve as technical lead for the migration of a ~20TB Microsoft SQL Server data warehouse to the Databricks Lakehouse Platform.
- Design and implement reusable Spark-based pipeline frameworks to replace thousands of SSIS workflows.
- Deconstruct SSAS cube logic and redesign it into Lakehouse-native semantic models.
- Replace legacy SSRS reporting ecosystems with modern, governed analytics layers.
- Rebuild dimensional models within Delta Lake using scalable Lakehouse design patterns.
- Define data modeling standards, ingestion frameworks, CI/CD processes, and operational best practices.
- Implement and enforce Medallion architecture standards (Bronze/Silver/Gold) with performance optimization and governance controls.
- Optimize Spark workloads for scalability, reliability, and cost efficiency.
- Implement governance, lineage, security, and monitoring using Unity Catalog and related platform tooling.
- Mentor engineers, conduct architectural reviews,



establish and maintain engineering standards.
- Partner with BI, analytics, and AI/ML teams to enable advanced analytics and downstream use cases.
- Influence platform roadmap and architectural decisions.

Required Qualifications

- Bachelor’s or master’s degree in computer science, engineering, or related field.
- 8 – 12 years of data engineering experience.
- 5+ years of hands-on experience building and operating production workloads on Databricks.
- Deep expertise in SQL, PySpark, and distributed data processing.
- Demonstrated leadership in structured enterprise BI modernization programs.
- Proven experience replacing SSIS-based ETL with scalable Spark-based frameworks.
- Strong understanding of SSAS cube architecture and semantic layer modernization.
- Experience designing and operating high-volume, enterprise-grade analytical data platforms.
- Solid knowledge of Delta Lake, Lakehouse and Medallion architectures, data versioning, and Workflows/Jobs orchestration.
- Experience implementing CI/CD, testing frameworks, and operational reliability for data platforms.
- AWS-based Databricks experience strongly preferred.

Preferred Skills

- Experience designing semantic layers and BI integrations (Power BI preferred).
- Exposure to Databricks AI/ML capabilities (MLflow, feature engineering, feature stores).
- Experience establishing enterprise migration patterns across distributed teams.
- Prior technical leadership experience in global or multi-team environments.
- Strong stakeholder engagement and communication skills.
- Databricks certification is a plus.

📌 Senior Databricks Engineer (Pune)
🏢 Judge India Solutions
📍 Pune