Detailed JD: -
- Extensive experience in designing and building data pipelines within an Azure Databricks Lakehouse environment.
- Robust understanding and practical experience with Spark and other big data technologies.
- Integrated spark jobs in Databricks to read and write structured, batch and streaming data
- Excellent coding skills in SQL and Python/PySpark.
- Proven expertise working with the Azure platform and its data services.
- Proactive attitude and a strong sense of ownership for delivered solutions.