Azure Data Engineer | Databricks | PySpark | ADF | 5-10 Years | MUM/BLR/CHN/HYD/GUR

Azure Data Engineer (5-10 Years)

Locations: Mumbai / Bangalore / Chennai / Hyderabad / Gurugram

Experience: 5-10 Years

Employment Type: Full time

Job Summary

We are looking for an experienced Azure Data Engineer to design, develop, and maintain scalable cloud-based data platforms and ETL/ELT pipelines. The ideal candidate should have strong expertise in Azure Data Services, Databricks, PySpark, Data Factory, and modern Data Lake architectures.

Skills commonly associated with Azure Data Engineering environments include Azure Databricks, Azure Data Factory (ADF), PySpark, Spark SQL, Delta Lake, ADLS Gen2, Azure Synapse, and CI/CD practices. [Naukri_Pra...5y_0m] (2) | Word]

Key Responsibilities

- Design and develop scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Build and optimize data transformation workflows using PySpark and Spark SQL.
- Implement Lakehouse and Medallion Architecture (Bronze, Silver, Gold).
- Develop and manage Delta Lake tables and data models for analytics.
- Integrate data from multiple sources including SQL Server, APIs, cloud storage, and enterprise applications.
- Implement incremental data loads using CDC and watermarking techniques.
- Optimize Spark workloads through partitioning, caching, and performance tuning.
- Ensure data security using Azure Key Vault, Managed Identities, and RBAC.
- Support CI/CD deployments using Azure DevOps.
- Collaborate with business stakeholders, architects, analysts, and data scientists.

Required Skills
- Azure Databricks




- Azure Data Factory (ADF)
- PySpark
- Spark SQL
- Azure Data Lake Storage Gen2 (ADLS)
- Delta Lake
- Azure Synapse Analytics
- SQL
- Python
- Azure DevOps
- Data Warehousing Concepts
- ETL/ELT Development

These technologies are aligned with skills found in Azure Data Engineering profiles and implementations. [Naukri_Pra...5y_0m] (2) | Word]

Preferred Skills

- Unity Catalog
- Delta Live Tables (DLT)
- Auto Loader
- Azure Functions
- Logic Apps
- Service Bus
- Azure SQL Database
- ARM Templates
- Agile Development Methodology

[Naukri_Pra...5y_0m] (2) | Word]

Qualifications

- Bachelor's or Master's degree in Computer Science, Engineering, IT, or related field.
- 5-10 years of IT experience with at least 3 years in Azure Data Engineering.
- Strong understanding of cloud-native data platforms and big data processing.

Keywords for Naukri Search

Azure Data Engineer, Azure Databricks, ADF, Azure Data Factory, PySpark, Spark SQL, Delta Lake, ADLS Gen2, Azure Synapse, Data Lake, ETL, ELT, Azure DevOps, Data Warehouse, Lakehouse Architecture.

Role: Data Engineer, Industry Type: IT Services & Consulting, Department: Engineering - Software & QA, Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate read more

Key Skills Skills highlighted with ‘‘ are preferred keyskills PySparkAzure DatabricksAzure Data Factory (ADF Azure Synapse AnalyticsSpark SQLAzure Data Lake Storage Gen2 (ADLS)Delta LakeETL/ELT DevelopmentAzure DevOpsSQLPythonData Warehousing Concepts

📌 Azure Data Engineer (Gurugram)
🏢 Tata Consultancy Services
📍 Gurugram