30 Sep
|
Deloitte
|
Bengaluru
30 Sep
Deloitte
Bengaluru
About the Company
About the Role
Position SummarySeeking an experienced Databricks Architect to join our Data & AI team, with strong hands-on expertise in designing and delivering enterprise-scale Databricks Lakehouse, data engineering, analytics and AI solutions.The role will support multiple strategic initiatives and requires strong expertise in Databricks and at least one cloud platform (Azure/AWS/GCP).
Responsibilities
- Design, develop, and optimize scalable batch and streaming data pipelines using Databricks, Delta Lake and Lakeflow.
- Design and implement Lakehouse architectures using Lakeflow Connect, Lakeflow SDP, Lakeflow Jobs, Auto Loader and CDC patterns.
- Leverage Databricks AI/BI and Genie capabilities to deliver business-facing analytics and AI-driven solutions.
- Implement Unity Catalog for data governance, security, access control, and lineage.
- Apply best practices for performance, scalability, reliability, cost optimization, and CI/CD using Databricks Asset Bundles and DevOps practices.
- Collaborate with business stakeholders, architects, and data teams to translate requirements into technical solutions.
- Troubleshoot complex production issues and provide timely resolution with minimal supervision.
Qualifications
- Atleast 10+ years of experience in Data Engineering, Data Architecture,
Analytics Engineering, or related roles.
- Strong hands-on experience with Databricks Lakehouse in enterprise environments.
- Robust expertise in Databricks and cloud technologies, including data engineering, BI, and AI-driven analytics use cases.
- Advanced proficiency in PySpark, Spark SQL, SQL, and Databricks notebooks.
- Experience building and optimizing ETL/ELT pipelines using Lakeflow, Delta Lake, Auto Loader, and CDC.
- Strong understanding of Unity Catalog, Delta Lake, Lakeflow, AI/BI, Genie and Databricks best practices.
- Databricks certification is mandatory.
- Experience working with structured and semi-structured data at scale.
- Ability to work independently with minimal oversight.
- Excellent problem-solving, architecture, and communication skills.
Required Skills
- Databricks Lakehouse
- Lakeflow / Lakeflow Connect / Lakeflow SDP / Lakeflow Jobs
- Unity Catalog
- Delta Lake
- AI/BI
- Lakebase
- PySpark / Spark SQL / SQL
- Auto Loader / CDC / SCD
- Databricks Asset Bundles (DAB) / CI-CD
- ETL/ELT Development
- Databricks Performance & Cost Optimization
- Agent Bricks
- Genie
- Azure / AWS / GCP
Preferred Skills
Pay range and compensation package
Equal Opportunity Statement
📌 Data Bricks Architect (Bengaluru)
🏢 Deloitte
📍 Bengaluru