Seeking an experienced Azure Databricks Engineer to design develop optimize and support scalable cloudbased data platforms using Azure Data Services The candidate will be responsible for building highperformance data pipelines implementing data engineering best practices and driving data modernization initiatives
Key Responsibilities-
Design and implement scalable ETLELT pipelines using Azure Databricks and Azure Data Factory
Develop data processing solutions using PySpark Spark SQL and Python
Build and maintain Delta Lake architectures and Databricks workflows
Optimize performance of Spark jobs clusters and notebooks
Implement CICD pipelines using Azure DevOps for Databricks artifacts
Work with ADLS Gen2 Azure Synapse and Azure SQL for enterprise data solutions
Ensure data quality governance security and compliance standards
Monitor troubleshoot and support production data pipelines
Collaborate with architects business stakeholders and crossfunctional teams
Mentor junior engineers and participate in code reviews
Mandatory Skills-
Azure Databricks
PySpark Apache Spark
Azure Data Factory ADF
Azure Data Lake Storage ADLS Gen2
SQL TSQL
Python
Delta Lake
Databricks Workflows
Azure DevOps CICD
Data Modeling
Git Version Control
GoodtoHave Skills
Delta Live Tables DLT
Auto Loader
Unity Catalog
Azure Synapse Analytics
Apache Airflow
Power BI
Azure Key Vault
MLflow
Ansible
Data Governance Security Frameworks
Experience
7 to 11 years of overall ITData Engineering experience
3 years of handson Azure Databricks implementation experience
Experience building enterprisescale data platforms on Azure Cloud
Preferred Certifications-
Microsoft Certified Azure Data Engineer Associate DP203
Databricks Certified Data Engineer AssociateProfessional
Azure Fundamentals AZ900
Key Competencies
Solid analytical and problemsolving skills
Stakeholder management
Technical leadership and mentoring
Agile delivery experience
Excellent communication and collaboration skills
Mandatory Skills : Azure Databricks, PySpark Apache Spark,Azure Data Factory ADF,Azure Data Lake Storage ADLS Gen2,SQL TSQL, Python, Delta Lake
📌 Specialist - Data Engineering (Chennai)
🏢 LTM
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.