09 Sep
|
Allison Transmission
|
Pune
09 Sep
Allison Transmission
Pune
Job DescriptionWe are seeking an experienced Data Engineer to join our growing data team and play a key role in modernizing our analytics platform. In 2026, we will be executing a large-scale migration and rehydration of ~500 existing Power BI reports, including re-connecting and optimizing data sources in a new Lakehouse setting. NKey Responsibilitiesn N Design, build, and maintain scalable data pipelines using Databricks (Delta Lake, Unity Catalog, Spark). N Lead or significantly contribute to the migration and rehydration of approximately 500 Power BI reports in 2026, including re-pointing and optimizing data sources. N Implement and maintain CI/CD pipelines for data assets using Databricks Asset Bundles (DAB), GitHub Actions, and other modern DevOps practices. N Collaborate with data analysts, BI developers, and business stakeholders to ensure data availability, performance, and reliability. N Optimize ETL/ELT processes for performance, cost, and maintainability. N Establish best practices for version control, testing, and deployment of notebooks, workflows, and Delta Live Tables. NnRequired Experience & Skills Nn 4+ years of hands-on data engineering experience (5-7+ years of experience overall). N Strong proficiency in Python and SQL.
N Deep experience with Databricks (workspace administration, cluster management, Delta Lake, Unity Catalog, workflows, and notebooks). N Proven track record implementing CI/CD for data workloads (preferably using Databricks Asset Bundles and GitHub Actions). N Solid understanding of Spark (PySpark and/or Spark SQL). N Experience with infrastructure-as-code and modern data DevOps practices. N Relevant certificationsstrongly preferred: N Databricks Certified Data Engineer Associate or Professional N Azure Data Engineer Associate (DP-203) or equivalent AWS/GCP certifications NnNice-to-Have / Bonus Skills Nn Experience extracting data from SAP/HANA or S/4HANA systems (via ODP, CDS views, SDA, etc.). N Previous large-scale Power BI migration or re-platforming projects. N Familiarity with Databricks SQL warehouses, Serverless, or Lakehouse Monitoring. N Experience with dbt, Delta Live Tables, or Lakeflow. NnIf you have strongDatabricks + CI/CD + Asset Bundles experience and are excited about transforming a large Power BI footprint into a modern Lakehouse architecture, we'd love to talk!
📌 Data Engineer - Databricks Focus (Pune)
🏢 Allison Transmission
📍 Pune