Detailed JD: -
- Extensive experience in designing and building data pipelines within an Azure Databricks Lakehouse environment.
- Strong understanding and practical experience with Spark and other big data technologies.
- Integrated spark jobs in Databricks to read and write structured, batch and streaming data
- Excellent coding skills in SQL and Python/PySpark.
- Proven expertise working with the Azure platform and its data services.
- Proactive attitude and a solid sense of ownership for delivered solutions.