Job Description

We are seeking an experienced Data Engineer to join our growing data team and play a key role in modernizing our analytics platform. In 2026, we will be executing a large-scale migration and rehydration of ~500 existing Power BI reports, including re-connecting and optimizing data sources in a new Lakehouse environment.

n

n

Key Responsibilities

n

n
- Design, build, and maintain scalable data pipelines using Databricks (Delta Lake, Unity Catalog, Spark).
n
- Lead or significantly contribute to the migration and rehydration of approximately 500 Power BI reports in 2026, including re-pointing and optimizing data sources.
n
- Implement and maintain CI/CD pipelines for data assets using Databricks Asset Bundles (DAB), GitHub Actions, and other modern DevOps practices.
n
- Collaborate with data analysts, BI developers, and business stakeholders to ensure data availability, performance, and reliability.
n
- Optimize ETL/ELT processes for performance, cost, and maintainability.
n
- Establish best practices for version control, testing, and deployment of notebooks, workflows, and Delta Live Tables.
n

n

Required Experience & Skills

n

n
- 4+ years of hands-on data engineering experience (5-7+ years of experience overall).
n
- Robust proficiency in Python and SQL .




n
- Deep experience with Databricks (workspace administration, cluster management, Delta Lake, Unity Catalog, workflows, and notebooks).
n
- Proven track record implementing CI/CD for data workloads (preferably using Databricks Asset Bundles and GitHub Actions ).
n
- Solid understanding of Spark (PySpark and/or Spark SQL).
n
- Experience with infrastructure-as-code and modern data DevOps practices.
n
- Relevant certifications strongly preferred:
n
- Databricks Certified Data Engineer Associate or Professional
n
- Azure Data Engineer Associate (DP-203) or equivalent AWS/GCP certifications
n

n

Nice-to-Have / Bonus Skills

n

n
- Experience extracting data from SAP/HANA or S/4HANA systems (via ODP, CDS views, SDA, etc.).
n
- Previous large-scale Power BI migration or re-platforming projects.
n
- Familiarity with Databricks SQL warehouses, Serverless, or Lakehouse Monitoring.
n
- Experience with dbt, Delta Live Tables, or Lakeflow.
n

n

If you have strong Databricks + CI/CD + Asset Bundles experience and are excited about transforming a large Power BI footprint into a modern Lakehouse architecture, we’d love to talk!

n

📌 Data Engineer - Databricks Focus (Pune)
🏢 Allison Transmission
📍 Pune