Job Description: Senior Databricks Engineer

We are seeking a Senior Databricks Engineer to design and implement scalable, high-performance data engineering solutions on the Databricks Lakehouse Platform. In this role, you will be responsible for building and maintaining robust data pipelines, Delta Lake architectures, and feature stores that power analytics, reporting, and machine learning at enterprise scale.

The ideal candidate combines deep expertise in Apache Spark with hands-on Databricks platform mastery, and approaches every pipeline with a mindset that balances throughput performance with data quality guarantees and governance requirements.

Core Requirements

- Experience: 6+ years in Data Engineering with at least 3 years of hands-on Databricks platform experience in a production environment.
- Databricks Expertise: Deep knowledge of Databricks Runtime, cluster management, Delta Lake, DLT, Unity Catalog, and Databricks Workflows.
- Spark Proficiency: Expert-level PySpark and Spark SQL development,



including understanding of the Spark execution model, lazy evaluation, and DAG optimization.
- Cloud Platforms: Hands-on experience deploying Databricks on AWS, Azure (ADLS Gen2), or GCP with associated IAM and networking configurations.
- Python Development: Robust Python skills for pipeline logic, data transformations, utility libraries, and automation scripts.
- Data Governance: Experience implementing data governance controls on the Lakehouse including column masking, row-level security, and audit logging.

Skill / Area

Core Platform

Databricks, Delta Lake, Delta Live Tables, Unity Catalog

Languages

PySpark, Spark SQL, Python, SQL

Cloud Infrastructure

Azure (ADLS Gen2), AWS (S3), GCP (GCS)

Orchestration

Databricks Workflows, Apache Airflow, Azure Data Factory

More info : [email protected]/(phone hidden)

📌 Senior Azure Data Engineer (Noida)
🏢 NLB Services
📍 Noida