Azure Databricks, Azure Data Engineering Job Description We are looking for an experienced
Azure Databricks Developer
to design, develop, and optimize scalable data solutions on the Azure cloud platform. The ideal candidate should have solid expertise in Azure Databricks, PySpark, Data Engineering, and modern data warehousing concepts. Key Responsibilities Develop and maintain ETL/ELT data pipelines using Azure Databricks and PySpark. Design and implement scalable data processing solutions for structured and unstructured datasets. Build, optimize, and manage Delta Lake architectures. Integrate data from multiple sources such as Azure Data Lake Storage, Azure SQL Database, APIs, and third-party systems. Collaborate with business stakeholders, data architects, and analytics teams to understand requirements. Monitor, troubleshoot,
and optimize data workflows for performance and reliability. Implement data quality, governance, and security best practices. Support data migration and modernization initiatives on Azure. Mandatory Skills 7+ years of IT experience with strong Data Engineering background. Hands-on experience in
Azure Databricks . Strong proficiency in
PySpark
and Spark SQL. Experience with
Azure Data Factory (ADF) . Knowledge of
Azure Data Lake Storage (ADLS Gen2) . Experience with Delta Lake and Lakehouse architecture. Strong SQL development and performance tuning skills. Understanding of Data Warehousing concepts and ETL frameworks. Experience with Git-based source control and CI/CD pipelines.
📌 Data Engineer (Mumbai)
🏢 Tata Consultancy Services
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.