We are seeking a Data Engineer with robust expertise in Databricks, PySpark, Python, and Data Lake settings to develop high-performance data transformation and analytics solutions.
Key Responsibilities:
Develop and optimize data transformation logic using PySpark on Azure Databricks .
Work with Azure Data Lake (ADLS) to process and manage structured and unstructured data.
Build efficient data processing pipelines and support curated data layers (silver/gold) .
Use Python for data transformation, automation, and performance optimization.
Collaborate with stakeholders to deliver analytics-ready datasets and business insights .
Must-Have Skills:
Robust experience in Databricks and PySpark
Proficiency in Python for data processing
Implementation exp atlest 1 Project.
Hands-on experience with Azure Data Lake (ADLS)
Experience in data transformation and large-scale data processing