Role Overview:
We are seeking a Data Engineer with robust expertise in Databricks, Py Spark, Python, and Data Lake environments to develop high-performance data transformation and analytics solutions.
Key Responsibilities:
Develop and optimize data transformation logic using Py Spark on Azure Databricks. Work with Azure Data Lake (ADLS) to process and manage structured and unstructured data. Build effective data processing pipelines and support curated data layers (silver/gold). Use Python for data transformation, automation, and performance optimization. Collaborate with stakeholders to deliver analytics-ready datasets and business insights. Must-Have Skills:
Solid experience in Databricks and Py Spark Proficiency in Python for data processing Implementation exp atlest 1 Project. Hands-on experience with Azure Data Lake (ADLS) Experience in data transformation and large-scale data processing