Role: Tech Lead – Databricks / Data
Platform
Location: Remote
Employment Type: Full-Time
Experience: 10–12 Years

JOB
SUMMARY

We
are looking for an experienced Tech Lead – Databricks / Data Platform to
lead the design, development, and optimization of a scalable, secure, and
reliable cloud-based data platform. The role will provide technical leadership
across Databricks, Azure, CI/CD, Infrastructure as Code, orchestration, data
security, FinOps, and platform automation.

The
ideal candidate will be hands-on, technically strong, and experienced in
leading engineering teams while partnering closely with Data Engineers,
Analytics Engineers, Architects, Security, and Cloud teams to deliver
enterprise-grade data solutions.

KEY
RESPONSIBILITIES
- Lead
the architecture, design, and implementation of Databricks-based data
platforms and cloud-native data pipelines.
- Design
and implement robust CI/CD pipelines for data ingestion,
transformation, dbt, SQL, notebooks, and Databricks workloads.
- Lead
end-to-end orchestration of Databricks Jobs and Workflows,




including ingestion, transformation, data quality checks, and
dependencies.
- Define
and implement automated testing and quality gates within CI/CD
pipelines, including schema, data model, and contract validation.
- Drive Infrastructure
as Code (IaC) practices using Terraform and reusable modules for
Databricks and Azure infrastructure.
- Automate
Databricks platform operations, including workspace and cluster
provisioning, runtime and library management, job deployment,
configuration, and workplace management.
- Establish
and maintain Identity and Access Management (IAM) across Databricks
and Azure, including RBAC, TBAC, service principals, groups, roles, and
workspace/cluster/table-level access controls.
- Work
closely with the EDP Architect and Security teams to implement secure and
scalable Unity Catalog and data governance patterns.
- Develop
reusable Terraform modules, Databricks job templates, Airflow DAG
patter

📌 Tech Lead – Databricks (Pune)
🏢 Palo Alto Labs
📍 Pune