Roles & Responsibilities

KEY RESPONSIBILITIES

1. Solutioning & Architecture
- Translate client requirements into Databricks-based solution designs - data pipelines, Lakehouse layouts, and serving layers.
- Recommend the right Databricks components (Delta Live Tables, Workflows, Unity Catalog, Databricks SQL, Genie) for a given use case, based on data volume, latency, and governance needs.
- Participate in pre-sales and proposal discussions, contributing effort estimates and technical approach for Databricks-based engagements.
- Review architecture decisions with senior architects and flag risks or better alternatives early.

2. Hands-On Build & Delivery
- Build and maintain end-to-end pipelines: ingestion (Auto Loader, DLT), transformation (dbt or native PySpark/SQL), and serving (Unity Catalog, Databricks SQL).
- Work directly with pharma commercial datasets - IQVIA, Symphony, CRM, Hub/SP, claims - modeling them into clean, governed Delta Lake structures.
- Develop and maintain reusable components: notebooks, job templates, SQL libraries, and data quality checks.




- Configure and tune Genie Spaces and AI/BI dashboards for client-facing analytics use cases.
- Own workspace-level hygiene: cluster policies, job scheduling, cost tracking, and basic performance tuning.

3. Platform Currency & Best Practices
- Stay closely tracked with new Databricks releases and features (e.g. Lakehouse//RT, Genie enhancements, Metric Views) and assess their relevance to pharma use cases.
- Bring current capabilities into existing client engagements where they create real value, not just for novelty.
- Contribute to and maintain DataZymes' internal Databricks standards, templates, and knowledge base.
- Support the certification and upskilling of junior engineers and analysts on the team.

4. Client & Team Collaboration
- Act as the day-to-day Databricks technical point of contact on assigned client engagements.
- Explain technical trade-offs in plain terms to non-technical stakeholders whe

📌 Databricks Engineer (Bengaluru)
🏢 Confediantial
📍 Bengaluru