We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Azure Synapse Analytics and PySpark to design, develop and optimise enterprise-scale data platforms. The candidate should have hands-on experience building end-to-end data pipelines, enabling modern analytics solutions, and delivering scalable data engineering implementations.
*Key Responsibilities*
Design, develop and maintain scalable data ingestion, transformation and orchestration pipelines.
Build enterprise-grade data solutions using Microsoft Fabric and Azure Synapse Analytics.
Develop batch and near real-time data processing pipelines using PySpark.
Design and implement Lakehouse, Data Warehouse and Data Lake solutions.
Build and optimise ETL/ELT frameworks for structured and unstructured data.
Ensure data quality, governance, security and performance across the data platform.
Collaborate with business stakeholders, architects and analytics teams to understand and deliver data requirements.
Monitor,
troubleshoot and optimise data pipelines for reliability and scalability.
Support reporting, analytics and AI/ML workloads through robust data engineering practices.
Mandatory Skills
8+ years of experience in Data Engineering.
Strong hands-on experience with Microsoft Fabric.
Experience working on Azure Synapse Analytics.
Strong proficiency in PySpark.
Experience building enterprise-scale end-to-end data pipelines.
Expertise in Data Lake, Data Warehouse and Lakehouse architectures.
Solid SQL development and performance tuning skills.
Experience with ETL/ELT design, development and optimisation.
Good understanding of Azure Data Platform services.
Experience working in Agile delivery environments.
*Preferred Skills*
Azure Data Factory (ADF)
Delta Lake
Medallion Architecture
Databricks
Power BI
CI/CD implementation for data engineering solutions
Data governance, lineage and security frameworks