Azure Databricks Lead (Hyderabad)

Azure Databricks Lead (Hyderabad)

30 Sep
|
Droisys
|
Hyderabad

30 Sep

Droisys

Hyderabad

About Company,

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.

Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters.

We’re hiring Azure Databricks Lead in Hyderabad, IN

Overview

We are looking for an experienced Azure Databricks Lead to lead the design, development, and implementation of scalable data engineering and analytics solutions on Microsoft Azure and Databricks. The ideal candidate will have strong expertise in cloud data platforms, data pipelines, ETL/ELT, Spark, SQL, and modern data architecture, along with proven experience leading technical teams and working with business stakeholders.

Key Responsibilities

- Lead the design and development of scalable Azure Databricks data engineering solutions.
- Design and implement robust ETL/ELT pipelines using Databricks, Apache Spark, and Azure data services.
- Develop complex data transformations using PySpark, Python, and SQL.
- Build and optimize data pipelines using Azure Data Factory (ADF) and Databricks workflows.
- Design and implement Delta Lake / Lakehouse architectures and data processing frameworks.
- Integrate data from multiple sources including databases, APIs, files, SaaS applications, and enterprise systems.
- Implement data quality, validation, monitoring,



error handling, and performance optimization.
- Work with Azure services such as ADLS Gen2, Azure Synapse Analytics, Azure Key Vault, Azure Functions, and Event Hubs.
- Lead technical discussions, architecture reviews, code reviews, and solution design sessions.
- Mentor and guide data engineers and ensure adherence to development standards and best practices.
- Collaborate with architects, business analysts, product teams, and stakeholders to understand requirements and translate them into technical solutions.
- Implement CI/CD processes for data engineering workloads using Azure DevOps/Git.
- Monitor and troubleshoot production data pipelines and resolve performance and reliability issues.
- Ensure solutions follow security, governance, scalability, and cost-optimization best practices.

Required Technical Skills
- Strong hands-on experience with Azure Databricks.
- Strong expertise in Apache Spark and PySpark.
- Advanced Python and SQL skills.
- Experience with Azure Data Factory (ADF).
- Strong understanding of Azure Data Lake Storage Gen2 (ADLS).
- Experience with Delta Lake and Lakehouse architecture.
- Strong knowledge of data warehousing, dimensional modeling, and ETL/ELT concepts.
- Experience with Azure Synapse Analytics or similar cloud data warehouse technologies.
- Experience with Git and Azure DevOps.
- Knowledge of data security, governance, access control, and performance optimization.
- Experience designing scalable and high-performance data pipelines.





Preferred Skills
- Experience with Databricks Unity Catalog.
- Knowledge of Delta Live Tables / Lakeflow and Databricks Workflows.
- Experience with streaming technologies such as Kafka or Azure Event Hubs.
- Knowledge of Terraform or Infrastructure as Code (IaC).
- Experience with CI/CD automation for Databricks.
- Databricks or Azure certifications are a plus.
- Experience working in Agile/Scrum environments.
- Strong stakeholder management and communication skills.

Leadership Responsibilities
- Provide technical leadership and guidance to the data engineering team.
- Review technical designs and ensure alignment with enterprise architecture.
- Establish coding, testing, deployment, and documentation standards.
- Conduct code reviews and support developers in resolving complex technical challenges.
- Identify opportunities for performance improvement, automation, and cost optimization.
- Coordinate with offshore/onshore teams and manage technical deliverables.

Education Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

Ideal Candidate The ideal candidate should combine strong hands-on Azure Databricks expertise with technical leadership experience, and should be comfortable designing end-to-end cloud data solutions while mentoring engineers and collaborating with business and technology stakeholders.

Droisys is an equal prospect employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Droisys believes in diversity, inclusion, and belonging, and we are committed to fostering a diverse work environment

📌 Azure Databricks Lead (Hyderabad)
🏢 Droisys
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks lead (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks lead (hyderabad) / hyderabad