02 Oct
|
Deloitte
|
Bengaluru
02 Oct
Deloitte
Bengaluru
About the Company
About the Role
Position SummarySeeking an experienced Databricks Architect to join our Data & AI team, with strong hands-on expertise in designing and delivering enterprise-scale Databricks Lakehouse, data engineering, analytics and AI solutions.The role will support multiple strategic initiatives and requires robust expertise in Databricks and at least one cloud platform (Azure/AWS/GCP).
Responsibilities
• Design, develop, and optimize scalable batch and streaming data pipelines using Databricks, Delta Lake and Lakeflow.
• Design and implement Lakehouse architectures using Lakeflow Connect, Lakeflow SDP, Lakeflow Jobs, Auto Loader and CDC patterns.
• Leverage Databricks AI/BI and Genie capabilities to deliver business-facing analytics and AI-driven solutions.
• Implement Unity Catalog for data governance, security, access control, and lineage.
• Apply best practices for performance, scalability, reliability, cost optimization, and CI/CD using Databricks Asset Bundles and DevOps practices.
• Collaborate with business stakeholders, architects,
and data teams to translate requirements into technical solutions.
• Troubleshoot complex production issues and provide timely resolution with minimal supervision.
Qualifications
• Atleast 10+ years of experience in Data Engineering, Data Architecture, Analytics Engineering, or related roles.
• Strong hands-on experience with Databricks Lakehouse in enterprise environments.
• Strong expertise in Databricks and cloud technologies, including data engineering, BI, and AI-driven analytics use cases.
• Advanced proficiency in PySpark, Spark SQL, SQL, and Databricks notebooks.
• Experience building and optimizing ETL/ELT pipelines using Lakeflow, Delta Lake, Auto Loader, and CDC.
• Strong understanding of Unity Catalog, Delta Lake, Lakeflow, AI/BI, Genie and Databricks best practices.
• Databricks certification is mandatory.
• Experience working with structured and semi-structured data at scale.
• Ability to w
📌 Data Bricks Architect (Bengaluru)
🏢 Deloitte
📍 Bengaluru