02 Oct
|
Consultbae India
|
Bengaluru
02 Oct
Consultbae India
Bengaluru
Role Overview
Seeking a Databricks Architect to provide senior technical leadership across data architecture and analytics engineering. The role focuses on designing and owning production-grade Databricks Lakehouse platforms, leading complex data engineering initiatives, and bridging data engineering, analytics, and AI/ML.
Must-Have Skills – Non-Negotiable
- Databricks – Hands-on production experience with Databricks Lakehouse architecture and engineering at scale.
- Python – Solid professional experience in data engineering and pipeline development.
- SQL – Advanced SQL for data modeling, transformation, and performance tuning.
Candidates must have hands-on experience in all three: Databricks + Python + SQL.
Key Responsibilities
- Design and own Databricks Lakehouse, Delta Lake, and Medallion Architecture.
- Build ingestion, transformation, and orchestration pipelines using Python, SQL, PySpark, and Databricks Workflows.
- Define data mesh, data products, data contracts, and self-service data patterns.
- Establish best practices for data quality, observability, governance,
and consumption.
- Support AI/ML, feature engineering, vector data, RAG, and MLflow workflows.
- Lead data migration, modernization, and platform consolidation initiatives.
- Evaluate technologies such as Unity Catalog, DLT, Apache Iceberg, and Mosaic AI.
- Provide technical leadership across data engineering, analytics, AI/ML, security, and platform teams.
- Mentor engineers and influence technical direction.
- Work with client stakeholders and leadership on architecture and technical roadmaps.
- Drive data governance, compliance, security, and Databricks FinOps.
Required Experience
- 6–9 years in Data Engineering, Analytics Engineering, or Data Architecture.
- Strong technical leadership experience on large-scale engagements.
- Production-level Databricks + Python + SQL expertise.
- Experience with Spark, dbt, Airflow/Dagster, Kafka, Fivetran/Airbyte, and cloud platforms.
- Strong understa
📌 Data Science (Bengaluru)
🏢 Consultbae India
📍 Bengaluru