Secondary Skills Data Warehouse ConceptDBTPython PowerBI
JD
10 years of experience of working on Azure and Databricks Lakehouse implementation with grasp of following
Have experience in building Databricks Lakehouse from a modelling and transformation ELT perspective
Analyze and understand the ETL workflows
2 Experience in SQL programming Pyspark Python or more years experience working as a Data Engineer Experience of developing in the Azure Contemporary Data Warehouse platform e g Azure Data Lake Azure Data Factory Azure Databricks Databricks Delta Lake etc
3 Experience handling structured and unstructured datasets
4 Good knowledge of DevOps and Github tools and deployment processes Automating data pipelines through a CI CD delivery methodology
5 Expertise on Databricks delta lake implementation Databricks architecture and configuration
6 Expertise in Azure Data Factory building pipelines and orchestration
7Should have prior experience doing SQL server migration to cloud
8Prior experience of migrating on premise SQL Server to Delta lake
9Expertise in Databricks Expert in ETL Pipelines
10In depth hands on implementation knowledge on Azure Databricks Delta Lake Delta table Managing Delta Tables Databricks Cluster Configuration Cluster policies
11Good Understanding of data modelling for data lake