We are seeking a Data Engineer with robust expertise in Databricks, PySpark, Python, and Data Lake environments to develop high-performance data transformation and analytics solutions.
Key Responsibilities:
- Develop and optimize data transformation logic using PySpark on Azure Databricks .
- Work with Azure Data Lake (ADLS) to process and manage structured and unstructured data.
- Build efficient data processing pipelines and support curated data layers (silver/gold) .
- Use Python for data transformation, automation, and performance optimization.
- Collaborate with stakeholders to deliver analytics-ready datasets and business insights .
Must-Have Skills:
- Strong experience in Databricks and PySpark
- Proficiency in Python for data processing
- Implementation exp atlest 1 Project.
- Hands-on experience with Azure Data Lake (ADLS)
- Experience in data transformation and large-scale data processing