Job highlights

- 5+ years data engineering experience with Databricks, strong SQL and Python skills, expertise in data pipelines and models

- Design, build, and operate reliable data pipelines and reusable data products; ensure data quality, monitoring, incident resolution, and implement security and governance

Job Summary

Design, build, and operate reliable data pipelines and reusable data products ensuring engineering quality, and accessible throughout the lifecycle.

Responsibilities

- Design and evolve data architectures, pipelines, and data models, making explicit trade-offs between business needs, reliability, complexity, and cost.

- Build and operate data integration and transformation processes across multiple sources, including incremental loading, schema changes, and safe reprocessing.

- Deliver trusted, reusable datasets and data products that support reporting, self-service analytics, and advanced analytics use cases.

- Own the operational quality of data solutions, including monitoring, incident resolution, data quality controls, performance, and cost optimization.





- Implement security, governance, and data lifecycle requirements in collaboration with data owners and corporate IT, within agreed responsibilities.

- Evaluate and adopt technologies and automation approaches that improve data engineering quality, reliability, and efficiency.

Requirements

- Bachelors or Masters degree with 5+ years of relevant experience with robust hands-on data engineering expertise, preferably in Databricks.

- Solid SQL and Python with demonstrated experience independently designing, delivering, and operating production data pipelines and data models.

- Practical knowledge of distributed processing, storage patterns, orchestration, and their architectural trade-offs.

- Hands-on experience with automated testing, CI/CD, monitoring, and troubleshooting production failures.

- Ability to translate complex business requirements into robust technical and analytical solutions.

📌 Senior Data Platform & Analytics Engineer (Pune)
🏢 ZF
📍 Pune