Job Description: Senior Databricks Engineer

We are seeking a Senior Databricks Engineer to design and implement scalable, high-performance data engineering solutions on the Databricks Lakehouse Platform. In this role, you will be responsible for building and maintaining robust data pipelines, Delta Lake architectures, and feature stores that power analytics, reporting, and machine learning at enterprise scale.
The ideal candidate combines deep expertise in Apache Spark with hands-on Databricks platform mastery, and approaches every pipeline with a mindset that balances throughput performance with data quality guarantees and governance requirements.

Core Requirements
Experience: 6+ years in Data Engineering with at least 3 years of hands-on Databricks platform experience in a production environment.
Databricks Expertise: Deep knowledge of Databricks Runtime, cluster management, Delta Lake, DLT, Unity Catalog, and Databricks Workflows.
¢ Spark Proficiency: Expert-level PySpark and Spark SQL development,



including understanding of the Spark execution model, lazy evaluation, and DAG optimization.
¢ Cloud Platforms: Hands-on experience deploying Databricks on AWS, Azure (ADLS Gen2), or GCP with associated IAM and networking configurations.
¢ Python Development: Robust Python skills for pipeline logic, data transformations, utility libraries, and automation scripts.
¢ Data Governance: Experience implementing data governance controls on the Lakehouse including column masking, row-level security, and audit logging.

Skill / AreaRequirementCore PlatformDatabricks, Delta Lake, Delta Live Tables, Unity CatalogLanguagesPySpark, Spark SQL, Python, SQLCloud InfrastructureAzure (ADLS Gen2), AWS (S3), GCP (GCS)OrchestrationDatabricks Workflows, Apache Airflow, Azure Data FactoryGovernanceUnity Catalog, row-level security, audit logging

More Info : [email protected]

📌 DataBricks Engineer (Uttar Pradesh)
🏢 NLB Services
📍 Uttar Pradesh