Job Role - Databricks Architect

Location: Bangalore

Experience: 10 – 16 Years

Qualification: Any Graduate | Any Post Graduate | Any Diploma

About the Role

We are looking for an experienced Databricks Architect with solid expertise in Azure Databricks, Python, PySpark, SQL, and enterprise data architecture. The ideal candidate should have hands-on experience designing scalable Lakehouse solutions, developing reusable metadata-driven Python frameworks, and leading Data Engineering teams while remaining actively involved in development.

Mandatory Technical Skills & Expertise

- Azure Databricks Architecture: Azure Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Databricks Workflows/Jobs, Databricks Asset Bundles (DAB).
- Python, PySpark & SQL: Advanced hands-on development, code reviews, performance tuning, troubleshooting, and optimization.
- Python Framework Development: Reusable, modular, metadata-driven, and configuration-driven Python frameworks for ingestion, transformation, validation, orchestration, and automation.
- Data Modeling & Architecture: Conceptual, Logical & Physical Data Modeling, Relational & Dimensional Modeling, Schema Design, Source-to-Target Mapping, CDC, SCD Type 2, and Historical Data Processing.
- Lakehouse Data Engineering: Bronze, Silver & Gold Architecture, Delta Tables, ETL/ELT Pipelines, Incremental Processing,



and Enterprise Data Transformation.
- Real-Time & Batch Processing: Spark Structured Streaming, Auto Loader, Azure Event Hubs, Delta Change Data Feed (CDF), and Batch/Streaming Ingestion Pipelines.
- Enterprise Data Architecture: Complex Data Pipeline Design, SQL DDL Scripting, Scalable Data Solutions, and Production-Ready Architecture.
- Leadership & Ownership: Experience leading Data Engineering teams with strong hands-on technical contribution, stakeholder management, and communication skills.
- Domain Knowledge: Working knowledge of Pharmaceutical / Life Sciences data and business processes.

Key Candidate Expectations

- 10+ years of overall IT experience with significant Data Engineering and Data Architecture experience.
- Strong hands-on expertise in Azure Databricks, Python, PySpark, and SQL.
- Proven experience designing reusable, metadata-driven frameworks.
- Ability to independently design, develop, review, and optimize complex data engineering solutions.
- Strong technical ownership, problem-solving, and stakeholder management skills.

Interested candidates can share their updated resumes:

Email: [email protected]

Call / WhatsApp: +91 (phone hidden)

If I'm unavailable on call, please leave a WhatsApp message, and I'll get back to you.

📌 Databricks Architect (Bengaluru)
🏢 Ipivot
📍 Bengaluru