28 Sep
|
Larsen u0026 Toubro Infotech Ltd (LTI)
|
Hyderabad
28 Sep
Larsen u0026 Toubro Infotech Ltd (LTI)
Hyderabad
Specialist - Data Engineering Role Summary Seeking an experienced Azure Databricks Engineer to design develop optimize and support scalable cloudbased data platforms using Azure Data Services The candidate will be responsible for building highperformance data pipelines implementing data engineering best practices and driving data modernization initiatives Key Responsibilities- Design and implement scalable ETLELT pipelines using Azure Databricks and Azure Data Factory Develop data processing solutions using PySpark Spark SQL and Python Build and maintain Delta Lake architectures and Databricks workflows Optimize performance of Spark jobs clusters and notebooks Implement CICD pipelines using Azure DevOps for Databricks artifacts Work with ADLS Gen2 Azure Synapse and Azure SQL for enterprise data solutions Ensure data quality governance security and compliance standards Monitor troubleshoot and support production data pipelines Collaborate with architects business stakeholders and crossfunctional teams Mentor junior engineers and participate in code reviews Mandatory Skills- Azure Databricks PySpark Apache Spark Azure Data Factory ADF Azure Data Lake Storage ADLS Gen2 SQL TSQL Python Delta Lake Databricks Workflows Azure DevOps CICD Data Modeling Git Version Control GoodtoHave Skills Delta Live Tables DLT Auto Loader Unity Catalog Azure Synapse Analytics Apache Airflow Power BI Azure Key Vault MLflow Ansible Data Governance Security Frameworks Experience 7 to 11 years of overall ITData Engineering experience 3 years of handson Azure Databricks implementation experience Experience building enterprisescale data platforms on Azure Cloud Preferred Certifications- Microsoft Certified Azure Data Engineer Associate DP203 Databricks Certified Data Engineer AssociateProfessional Azure Fundamentals AZ900 Key Competencies Solid analytical and problemsolving skills Stakeholder management Technical leadership and mentoring Agile delivery experience Excellent communication and collaboration skills
📌 Azure Databricks Data Engineer (Hyderabad)
🏢 Larsen u0026 Toubro Infotech Ltd (LTI)
📍 Hyderabad