Role Overview:
We are seeking a Data Engineer with solid expertise in Databricks, PySpark, Python, and Data Lake environments to develop high-performance data transformation and analytics solutions.
Key Responsibilities:
Develop and optimize data transformation logic using PySpark on Azure Databricks.
Work with Azure Data Lake (ADLS) to process and manage structured and unstructured data.
Build efficient data processing pipelines and support curated data layers (silver/gold).
Use Python for data transformation, automation, and performance optimization.
Collaborate with stakeholders to deliver analytics-ready datasets and business insights.
Must-Have Skills:
Strong experience in Databricks and PySpark
Proficiency in Python for data processing
Implementation exp atlest 1 Project.
Hands-on experience with Azure Data Lake (ADLS)
Experience in data transformation and large-scale data processing