17 Nov
|
absolutelabs.
|
Hyderabad
17 Nov
absolutelabs.
Hyderabad
Role & responsibilities
- Design and develop end-to-end data pipelines using Microsoft Fabric (Data Factory, Dataflows Gen2, Notebooks, Pipelines) and Azure Data Factory (ADF). Build and manage models in the Microsoft Fabric ecosystem.
- Build and manage data models across OneLake and Fabric Workspaces, ensuring well-structured environments, access, and collaboration across teams.
- Develop and optimise complex SQL, PySpark, and DAX queries for large-scale data processing and analytics workloads.
- Integrate Fabric workloads with Azure services including Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Azure Databricks, and Power BI.
- Implement medallion architecture and data modelling best practices, following standard SDLC practices to ensure data quality, consistency, and reliable releases.
- Collaborate with stakeholders to translate business requirements into scalable data solutions and reusable data assets.
- Ensure data governance, lineage tracking, and compliance using Microsoft Purview and Fabric's built-in governance features.
- Monitor, troubleshoot, and performance-tune data workflows, keeping an eye on capacity usage and cost efficiency (FinOps)
while ensuring SLAs are met.
- Participate in CI/CD pipeline setup for data workloads using Azure DevOps and Git-based version control.
Preferred candidate profile
- Design and develop end-to-end data pipelines using Microsoft Fabric (Data Factory, Dataflows Gen2, Notebooks, Pipelines); hands-on Azure Data Factory (ADF) experience is mandatory.
- Build and manage data models within the Microsoft Fabric ecosystem, including OneLake and Fabric Workspace setup and management.
- Develop and optimise complex SQL, PySpark, and DAX queries for large-scale data processing and analytics workloads.
- Integrate Fabric workloads with Azure services, including Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Azure Databricks, and Power BI.
- Implement medallion architecture (Bronze / Silver / Gold) and data modelling best practices, with a valuable grasp of SDLC processes to ensure data quality and consistency.
- Collaborate with stakeholders to translate business requirements into scalable data solutions and reusable data assets.
📌 Lead Azure Fabric Engineer (Hyderabad)
🏢 absolutelabs.
📍 Hyderabad