We are seeking a Data Engineer with strong expertise in Databricks, PySpark, Python, and Data Lake environments to develop high-performance data transformation and analytics solutions.
Key Responsibilities:
- Develop and optimize data transformation logic using PySpark on Azure Databricks.
- Work with Azure Data Lake (ADLS) to process and manage structured and unstructured data.
- Build efficient data processing pipelines and support curated data layers (silver/gold).
- Use Python for data transformation, automation, and performance optimization.
- Collaborate with stakeholders to deliver analytics-ready datasets and business insights.
Must-Have Skills:
- Solid experience in Databricks and PySpark
- Proficiency in Python for data processing
- Implementation exp atlest 1 Project.
- Hands-on experience with Azure Data Lake (ADLS)
- Experience in data transformation and large-scale data processing