04 Sep
|
curatAId
|
Karnataka
04 Sep
curatAId
Karnataka
We are seeking a highly skilled Lead Azure Data Engineer for our client,a leading global consulting firm. The ideal candidate will have a proven track record in architecting modern cloud data landscapes, hands-on experience building Medallion lakehouses, and a strong background in leading engineering teams to drive digital transformation initiatives. Job Title: Lead Azure Data Engineer (Databricks) Location: India (Noida / Mumbai / Bengaluru /Gurgaon/ Kolkata/Bhubaneswar/Chennai/Coimbatore) Level: Lead / Senior Consultant / Manager Application Steps Do not apply without hands-on experience in Azure Databricks and PySpark as your profile will be rejected. To help us assess technical skills quickly and prioritize your profile over others, please complete a 5-minute free interview here: Responsibilities Architect Data Landscapes: Architect Azure cloud data landscapes and up-to-date Medallion lakehouses (Bronze, Silver, Gold layers) for enterprise analytics. Pipeline Development: Build batch and real-time/streaming ETL pipelines using Azure Data Factory (ADF), Azure Databricks, and PySpark. Performance Optimization: Optimize complex Spark SQL jobs, Python data transformations, and cluster performance for maximum efficiency. Technical Leadership: Lead engineering teams through project delivery, conduct rigorous code reviews, and drive CI/CD deployment pipelines. Stakeholder Collaboration:
Collaborate with clients and cross-functional teams to translate business requirements into scalable technical solutions using Azure data services. Qualifications & Technical Stack Experience: 6 to 12 years of overall experience with a strong focus on Azure data engineering and analytics (including prior technical leadership/mentoring experience). Technical Stack: Core: Azure Databricks, Apache Spark, PySpark, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2). Languages & Querying: Python, SQL, Spark SQL, and Azure Synapse Analytics. Preferred Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) or Databricks Certified Data Engineer Professional. Soft Skills: Excellent problem-solving, communication, and client-facing consulting skills. Unfortunately, due to high volume of applicants, not everybody will receive a response. About Us curatAId is a hiring platform for the tech industry in India, providing pre-vetted candidates to recruiters. Our expert interviewers screen candidates based on their primary and secondary technical skills, as well as communication and behavioral traits, to provide recruiters with high-quality, qualified candidates. As a tech hiring platform, our goal is to simplify and streamline the recruitment process for both recruiters and job seekers.
📌 Lead Azure Data Engineer (Databricks) (Karnataka)
🏢 curatAId
📍 Karnataka