07 Aug
|
ACL Digital
|
Bengaluru
07 Aug
ACL Digital
Bengaluru
ACL is hiring Hiring: Lead Data Engineer (Azure & Databricks) | Bangalore Role: Lead Data Engineer
Experience Level: 7 to 9 Years
Location: Bengaluru / Bangalore,( Client Location )
Work Mode : Hydbrid
Notice period : Immediate to 15 days
Employment Type: Full time About the Role
We are looking for an experienced Lead Data Engineer to join our growing data practice in Bangalore. In this role, you will lead the architecture, design, and execution of enterprise-grade, cloud-native data pipelines and lakehouse solutions leveraging Azure Data Services and Azure Databricks. Key Responsibilities
Technical Leadership & Architecture: Lead the design and implementation of up-to-date data platform architectures (Medallion Architecture: Bronze, Silver, Gold layers) using Azure Data Services and Databricks Delta Lake.
Pipeline Engineering: Build and optimize end-to-end scalable, resilient batch and streaming ETL/ELT pipelines using PySpark, SQL, Azure Data Factory (ADF), and Databricks Workflows.
Performance Tuning & Cost Optimization: Perform deep-dive Spark tuning, cluster policy optimization, partitioning, liquid clustering, and query optimization to ensure cost-efficiency and high execution speeds.
📌 Data Engineer Bengaluru
🏢 ACL Digital
📍 Bengaluru