Job Role - Senior Azure Databricks Developer

Experience -7 Years

Location - Gurgaon

Key Responsibilities
Design and develop scalable data ingestion, transformation, and processing pipelines using Azure Databricks (PySpark/Scala).
Build and maintain ETL/ELT workflows for structured and unstructured data.
Implement and manage Delta Lake architecture and optimize performance of Spark jobs.
Integrate Azure Databricks with:
Azure Data Factory (ADF)
Azure Data Lake Storage Gen2 (ADLS)
Azure Synapse Analytics
Azure SQL Database
Event Hub/Kafka
Develop reusable frameworks, notebooks, and data engineering best practices.
Optimize Spark workloads through partitioning, caching, indexing, and cluster tuning.
Implement data quality checks, monitoring, and governance standards.
Collaborate with business stakeholders, architects, data scientists, and BI teams.




Support CI/CD implementation using Azure DevOps or GitHub Actions.
Troubleshoot production issues and provide performance improvements.

Required Skills

Azure & Databricks
Azure Databricks
PySpark / Apache Spark
Delta Lake
Unity Catalog
Databricks Workflows
Databricks SQL

Data Engineering
ETL/ELT Development
Data Warehousing Concepts
Data Lakehouse Architecture
Data Modeling

Azure Services
Azure Data Factory (ADF)
Azure Data Lake Storage Gen2 (ADLS)
Azure Synapse Analytics
Azure Key Vault
Azure Functions

Programming
Python (Advanced)
SQL (Advanced)
Scala (Preferred)

Version Control & DevOps
Git/GitHub
Azure DevOps
CI/CD Pipelines

📌 Azure Data Bricks Sr Developer Gurugram
🏢 Tata Consultancy Services
📍 Gurugram