We are seeking an experienced Azure Databricks Lead to drive the design, development, and implementation of data solutions using Azure Databricks. The ideal candidate will have a deep understanding of cloud-based data platforms, solid leadership skills, and a proven track record of managing complex data projects.
Key Responsibilities
- Lead the architecture, design, and deployment of scalable data solutions using Azure Databricks.
- Collaborate with stakeholders to gather requirements and translate them into technical specifications.
- Oversee the development of data pipelines, ETL processes, and machine learning workflows.
- Optimize the performance of data solutions, ensuring reliability and efficiency.
- Manage a team of data engineers and analysts, providing technical mentorship and guidance.
- Integrate Databricks with Azure cloud services such as Azure Data Lake, Azure Synapse, and Azure Machine Learning.
- Ensure adherence to best practices, security standards, and governance policies.
- Drive innovation by exploring and adopting emerging technologies in data engineering and analytics.
Required Skills and Qualifications
- 10+ years of experience in data engineering or related fields, with at least 3+ years on Azure Databricks.
- Expertise in designing and implementing large-scale data pipelines and workflows using Databricks and Apache Spark.
- Strong knowledge of Azure cloud services including Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure Functions.
- Proficiency in programming languages such as Python, Scala, or SQL.
- Hands-on experience with data modeling, ETL processes, and data transformation.
- Familiarity with DevOps practices and CI/CD pipelines for data projects.
- Excellent problem-solving skills and the ability to troubleshoot complex data issues.
- Strong communication and leadership skills to manage teams and interact with stakeholders.
-
About us
Swiftin
📌 SwiftIn-Azure Databricks Lead (Pune)
🏢 NextHire
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.