24 Aug
|
A2R GLOBAL
|
Bengaluru
24 Aug
A2R GLOBAL
Bengaluru
Job Title : Databricks Architect
Experience: 10+ Years
Location: Bengaluru
Role Overview
We are looking for an experienced Databricks Architect / Solution Architect with strong hands-on expertise in Databricks, Apache Spark, PySpark, cloud platforms, data engineering, and solution architecture.
The ideal candidate should have 10+ years of overall technology/consulting experience, 7+ years in Data Engineering/Big Data/Analytics, and
hands-on experience delivering 6–8+ end-to-end Databricks projects.
Key Responsibilities
- Design and implement scalable Databricks Lakehouse architectures.
- Lead end-to-end data engineering and platform architecture initiatives.
- Work directly with customers to understand business and technical requirements.
- Develop and optimize data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake.
- Design batch and real-time/streaming data processing solutions.
- Provide architecture guidance, development standards,
and Databricks best practices.
Mandatory Skills
- Strong hands-on Databricks development and architecture experience.
- Minimum 6–8 successful Databricks project implementations.
- Robust knowledge of:
- Delta Lake
- Databricks Lakehouse Architecture
- Unity Catalog
- Databricks Workflows
- Auto Loader
- Databricks SQL
- Lakeflow / DLT
- Serverless
- Batch and streaming workloads
- Cluster and compute configuration
- Performance optimization
Apache Spark / PySpark
- Strong hands-on experience with Apache Spark and PySpark.
- Deep understanding of Spark internals, including:
- Driver and Executors
- DAG
- Jobs, Stages, and Tasks
- Partitioning
- Shuffle
- Memory Management
- Catalyst Optimizer
- Adaptive Query Execution (AQE)
- Spark SQL execution plans
- Data skew
Work Location: In person
📌 Databricks Architect (Bengaluru)
🏢 A2R GLOBAL
📍 Bengaluru