10 Sep
|
Clifyx
|
Bengaluru
We are looking for an experienced Lead Data Engineer with solid expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, and SQL to design, develop, and optimize scalable data engineering solutions. The ideal candidate should have hands-on experience building up-to-date data platforms on Azure and leading technical teams.
Key Responsibilities
Design and develop scalable data pipelines using Azure Databricks and Azure Data Factory (ADF).
Build and optimize ETL/ELT workflows using PySpark.
Develop complex SQL queries, stored procedures, and performance tuning.
Implement data integration solutions from multiple structured and unstructured data sources.
Design and maintain data lakes and contemporary data warehouse solutions.
Ensure data quality, governance, security, and performance optimization.
Collaborate with business stakeholders, architects, and cross-functional teams to understand requirements.
Lead code reviews, mentor junior engineers, and drive engineering best practices.
Troubleshoot production issues and implement scalable solutions.
Work in Agile/Scrum development environments.
📌 Lead Data Engineer Bengaluru
🏢 Clifyx
📍 Bengaluru