06 Sep
|
curatAId
|
Karnataka
06 Sep
curatAId
Karnataka
We are seeking a highly skilled Lead Azure Data Engineer for our client,a leading global consulting firm. The ideal candidate will have a proven track record in architecting modern cloud data landscapes, hands-on experience building Medallion lakehouses, and a strong background in leading engineering teams to drive digital transformation initiatives. Job Title: Lead Azure Data Engineer (Databricks) Location: India (Noida / Mumbai / Bengaluru /Gurgaon/ Kolkata/Bhubaneswar/Chennai/Coimbatore) Level: Lead / Senior Consultant / Manager Application Steps Do not apply without hands-on experience in Azure Databricks and PySpark as your profile will be rejected. To help us assess technical skills quickly and prioritize your profile over others, please complete a 5-minute free interview here: Responsibilities Architect Data Landscapes: Architect Azure cloud data landscapes and contemporary Medallion lakehouses (Bronze, Silver, Gold layers) for enterprise analytics. Pipeline Development: Build batch and real-time/streaming ETL pipelines using Azure Data Factory (ADF), Azure Databricks,
and PySpark. Performance Optimization: Optimize complex Spark SQL jobs, Python data transformations, and cluster performance for maximum efficiency. Technical Leadership: Lead engineering teams through project delivery, conduct rigorous code reviews, and drive CI/CD deployment pipelines. Stakeholder Collaboration: Collaborate with clients and cross-functional teams to translate business requirements into scalable technical solutions using Azure data services. Qualifications & Technical Stack Experience: 6 to 12 years of overall experience with a strong focus on Azure data engineering and analytics (including prior technical leadership/mentoring experience). Technical Stack: Core: Azure Databricks, Apache Spark, PySpark, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2). Languages & Querying: Python, SQL, Spark SQL, and Azure Synapse Analytics. Preferred Certifications: Microsoft
📌 Lead Azure Data Engineer (Karnataka)
🏢 curatAId
📍 Karnataka