Data Engineer – Databricks

Experience: 4-6+ years

Location: Pune, India

Skills: Databricks, Spark, AWS, Delta Lake, Apache Spark, PySpark, Terraform, SQL, Python, CI/CD, DevOps, Unity Catalog

About the Role
We are looking for a Senior Data Engineer with strong hands-on experience in Databricks to build and scale up-to-date, cloud-native data platforms. You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions. This role will also be involved in migrating enterprise data workloads from AWS-based platforms to Databricks, contributing to our broader data modernization journey.

Key Responsibilities
Must have experience in requirement gathering, design, develop, and optimize data pipelines using Databricks and Apache Spark (PySpark).
• Build and manage Delta Lake Medallion architectures.
• Develop batch and streaming pipelines using Structured Streaming.
• Optimize Spark workloads for performance and cost efficiency.
• Implement Databricks Jobs, Workflows, and SQL.
• Ingest data from various relation databases, SAP, API’s, etc into databricks.
• Contribute to AWS (Glue/Redshift) → Databricks data migration initiatives.
• Implement data quality, security, and governance best practices.
• Collaborate with cross-functional teams and mentor junior engineers.

Required Skills & Experience
• 4 - 6+ years of experience in Data Engineering.




• Strong hands-on experience with Databricks on AWS.
• Advanced knowledge of Apache Spark (PySpark preferred).
• Experience with Terraform (IAC), Delta Lake, SQL, and Python.
• Solid understanding of cloud-native data architectures on Databricks & AWS.
• Experience building scalable, production-grade data pipelines.
• Strong problem-solving and communication skills.

Nice to Have
• Experience with Unity Catalog and data governance.
• Familiarity with CI/CD pipelines and DevOps best practices for data solutions.
• Familiarity with Terraform, dbt, or Airflow.
• Databricks certification (preferred, not mandatory).

Why Join Us?
• Work on large-scale data platform modernization.
• Hands-on ownership of Databricks Lakehouse architecture.
• Chance to work closely with AI/ML and advanced analytics teams.
• Strong engineering culture with growth and learning opportunities.
We are the world’s largest hydrogen producer with over 80 years of industrial gas experience. We are hydrogen and industrial gas experts delivering safe, end-to-end solutions, investing in real, clean energy projects at scale, and driving the industry forward to generate a cleaner future. At Air Products, we work in an workplace where we put safety first, diversity is essential, inclusion is our culture, and each person knows they belong and matter. To learn more, visit About Air Products.

📌 Data Engineer – Databricks (Pune)
🏢 Air Products
📍 Pune