Role Overview: As a Manager, you will lead the technical strategy and delivery of Databricks-centric data platforms. You will bridge the gap between business requirements and technical architecture, ensuring that the Databricks ecosystem is scalable, cost-effective (FinOps), and perfectly integrated into the broader Azure data landscape.
Experience:
- 7–10 years of experience in data engineering, with significant experience architecting solutions on Azure Databricks.
- Expertise in designing end-to-end Data Lakehouse architectures.
- Proven experience in Databricks FinOps (managing DBU consumption and cluster policies).
- Solid leadership experience in managing technical teams and project lifecycles.
Key Responsibilities: Technical Skills:
- Architect large-scale, enterprise-grade data platforms using the Databricks Data Intelligence Platform.
- Define and enforce technical standards for data modeling, Spark optimization, and coding patterns.
- Drive Databricks FinOps initiatives by designing efficient cluster policies and optimizing resource utilization.
- Lead the integration of Databricks with Azure Synapse, Power BI, and advanced Machine Learning workflows.
- Oversee the implementation of enterprise-wide data governance and security frameworks.
- Manage technical project delivery, ensuring alignment with business timelines and quality standards.
Soft Skills:
- Strong leadership, mentorship, and people management abilities.
- Strategic thinking and ability to translate business needs into technical roadmaps.
- Excellent stakeholder management and communication skills.
Preferred Qualifications:
- Bachelor’s or Master’s degree in Computer Science or related field.
- Databricks Solutions Architect or Azure Solutions Architect certifications.