Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Position Overview
We are seeking a highly skilled and experienced Senior Data Engineer with solid expertise in PySpark, Azure Databricks, ETL/ELT, Microsoft Azure, and Microsoft Fabric. The candidate will design, develop, deploy, and maintain scalable enterprise data solutions, with a strong focus on Medallion Architecture, Lakehouse patterns, secure data sharing, Fabric capacity utilization, data quality, performance, governance, and operational reliability.
Key Responsibilities
- Design, develop,



and maintain scalable batch and streaming data pipelines using PySpark, Azure Databricks, and Microsoft Fabric.
- Architect and implement Medallion Architecture across Bronze, Silver, and Gold layers for enterprise data processing and analytics.
- Build robust ETL/ELT solutions for data ingestion, transformation, validation, reconciliation, and delivery across multiple source systems.
- Develop and optimize PySpark and Spark SQL workloads for high-volume structured, semi-structured, and unstructured data.
- Design and maintain Lakehouse and data lake solutions using Azure Data Lake Storage Gen2, Delta Lake, Microsoft Fabric OneLake, Fabric Lakehouse, and Warehouse.
- Implement integration solutions using Azure Data Factory, Fabric Data Factory, data pipelines, notebooks, and Dataflows Gen2.
- Design secure and governed data-sharing solutions across workspaces, domains, business units, and approved external consumers.
- Implement reusa

📌 Senior Data Engineer (Bengaluru)
🏢 Caterpillar
📍 Bengaluru