Job Role - Senior Azure Databricks Developer
Experience -7+ Years
Location - Gurgaon
Key Responsibilities
Design and develop scalable data ingestion, transformation, and processing pipelines using Azure Databricks (PySpark/Scala).
Build and maintain ETL/ELT workflows for structured and unstructured data.
Implement and manage Delta Lake architecture and optimize performance of Spark jobs.
Integrate Azure Databricks with:
Azure Data Factory (ADF)
Azure Data Lake Storage Gen2 (ADLS)
Azure Synapse Analytics
Azure SQL Database
Event Hub/Kafka
Develop reusable frameworks, notebooks, and data engineering best practices.
Optimize Spark workloads through partitioning, caching, indexing, and cluster tuning.
Implement data quality checks, monitoring, and governance standards.
Collaborate with business stakeholders, architects, data scientists, and BI teams.
Support CI/CD implementation using Azure DevOps or GitHub Actions.
Troubleshoot production issues and provide performance improvements.
Required Skills
Azure & Databricks
Azure Databricks
PySpark / Apache Spark
Delta Lake
Unity Catalog
Databricks Workflows
Databricks SQL
Data Engineering
ETL/ELT Development
Data Warehousing Concepts
Data Lakehouse Architecture
Data Modeling
Azure Services
Azure Data Factory (ADF)
Azure Data Lake Storage Gen2 (ADLS)
Azure Synapse Analytics
Azure Key Vault
Azure Functions
Programming
Python (Advanced)
SQL (Advanced)
Scala (Preferred)
Version Control & DevOps
Git/GitHub
Azure DevOps
CI/CD Pipelines
📌 Azure Data Bricks Sr Developer (Gurugram)
🏢 Tata Consultancy Services
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.