18 Oct
|
iDWTeam
|
Hyderabad
Experience: 4–6 Years
Role: Microsoft Fabric Data Engineer
Employment Type: Full time
Work Location : Hyderabad
Work Model : Work from Office
Job Summary
We are looking for an experienced Microsoft Fabric Data Engineer with 4–6 years of experience in data engineering, data integration, and analytics solutions. The ideal candidate should have strong expertise in SQL, ETL/ELT development, data warehousing, and hands-on experience with Microsoft Fabric to build scalable and reliable data solutions.
Roles and Responsibilities
● Design, develop, and maintain scalable data pipelines using Microsoft Fabric Data Factory.
● Implement Lakehouse and Warehouse solutions using OneLake and Microsoft Fabric architecture.
● Develop ETL/ELT workflows to ingest, transform, and process data from multiple structured and unstructured sources.
● Work with Fabric Notebooks using Python, PySpark, and Spark SQL for large-scale data processing.
● Develop and optimize complex SQL queries, stored procedures, and data transformation logic.
● Build and manage Dataflows Gen2, pipelines, Lakehouse tables,
and Warehouse objects.
● Implement incremental data loads, error handling, logging, and pipeline monitoring.
● Optimize Spark jobs, SQL queries, and data pipelines for performance and cost efficiency.
● Collaborate with Power BI developers to prepare curated datasets and semantic models for reporting and analytics.
● Implement data quality checks, validation rules, and reconciliation processes.
● Apply security, governance, access control, and workspace management best practices.
● Troubleshoot production issues, resolve data pipeline failures, and maintain technical documentation.
● Work with Git, deployment pipelines, and CI/CD processes to support controlled releases across environments.
Required Skills
● 4–6 years of experience in data engineering, ETL development, or related data platform roles.
● Hands-on experience with Microsoft Fabric and its core data engineering components and exp
📌 Sr Microsoft Fabric Data Engineer (Hyderabad)
🏢 iDWTeam
📍 Hyderabad