Databricks Architect / Lead Data Engineer (Bengaluru)

Databricks Architect / Lead Data Engineer (Bengaluru)

06 Aug
|
SKS Talent Solutions
|
Bengaluru

06 Aug

SKS Talent Solutions

Bengaluru

We are seeking a high-caliber, hands-on Databricks Architect / Lead Engineer who possesses the rare blend of enterprise solution design and deep, programmatic execution. You will design end-to-end architectures and actively code the pipelines yourself, while serving as the primary client-facing technical point of contact.

Role Overview

- Position: Databricks Architect / Lead Data Engineer
- Location: Bangalore, India (Onsite/Hybrid - Relocation support available)
- Experience: 6+ Years (Min. 3 years hands-on Databricks)
- Compensation: Competitive (Includes a 20% variable component as part of the total CTC)

Key Responsibilities1. Solutioning & Architecture

- Translate complex pharma business requirements into scalable Databricks solution designs (data pipelines, Lakehouse layouts, and serving layers).
- Architect solutions using optimal components (Delta Live Tables, Workflows, Unity Catalog, Databricks SQL, Genie) tailored to data volume, latency, and governance needs.
- Review architectural decisions with senior leadership to mitigate risks and introduce performance-optimized alternatives early.
- Support pre-sales engineering and practice leads with effort estimations and technical frameworks for incoming client proposals.

2. Hands-On Build & Delivery

- Design, build, and maintain end-to-end data pipelines: ingestion (Auto Loader, DLT), transformation (dbt or native PySpark/SQL), and serving layers.
- Work directly with major pharma commercial datasets (IQVIA, Symphony, CRM, Hub/SP, claims), modeling them into clean, governed Delta Lake structures.
- Deploy workspace-level hygiene policies, including cluster optimization, job scheduling, advanced performance tuning, and cloud cost tracking.
- Configure and tune cutting-edge Genie Spaces and AI/BI dashboards for real-time analytics.

3. Practice Building & Innovation

- Establish reference architectures,



coding standards, and reusable code libraries as the practice scales.
- Design and build solution accelerators for repeatable pharma use cases (e.g., prescription analytics, patient cohort analysis, omnichannel attribution).
- Mentor, train, and support the upskilling/certification tracks of junior engineers on the team.

Technical Skills Required

- Core Ecosystem: Complete Databricks Stack (Delta Lake, DLT, Unity Catalog, Auto Loader, Databricks SQL, Workflows).
- Languages: Advanced Python/PySpark and Expert-level SQL.
- Frameworks: PyTorch (highly preferred for AI/BI enablement).
- Data Modeling: Strong fundamentals in Data Vault, Dimensional Modeling, and Star/Snowflake schemas.
- BI Integration: Tableau (Dashboarding, connectivity, and performance tuning).

Ideal Candidate Profile

- The "Do-It-All" Engineer: Must be a builder who can design a complex cloud architecture on a whiteboard and then open an IDE to write the production code themselves.
- Certifications: Must hold an active Databricks Professional-level certification (Data Engineer Skilled preferred). Candidates with an Associate certification coupled with exceptional, deep hands-on project experience will be considered.
- Communication: Exceptional client-facing communication. You must be comfortable translating technical trade-offs into plain business terms for stakeholders.
- Domain Expertise: Prior experience working within the Pharmaceutical, Life Sciences, or Healthcare analytics domain is highly preferred.

How to Apply Interested candidates can share their updated Resume on WhatsApp +91-(phone hidden)

Pay: ₹1,800,000.00 - ₹3,000,000.00 per year

Application Question(s)

- Do you hold an active Databricks Professional certification? If yes, please specify which one.
- How many years of hands-on experience do you have specifically within the Databricks platform?

Work Location: In person

📌 Databricks Architect / Lead Data Engineer (Bengaluru)
🏢 SKS Talent Solutions
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: databricks architect / lead data engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: databricks architect / lead data engineer (bengaluru) / bengaluru