Key Responsibilities

Design and develop scalable end-to-end data pipelines using Microsoft Fabric.

Build and manage Fabric Lakehouse and Warehouse solutions.

Develop data ingestion and transformation pipelines using Data Factory and Dataflows Gen2.

Use PySpark, Spark SQL, and SQL for data transformation and processing.

Implement incremental loading, CDC, data partitioning, and performance optimization.

Develop and maintain Medallion Architecture (Bronze, Silver, Gold).

Integrate data from databases, APIs, files, cloud storage, and other enterprise systems.

Implement data quality, validation, monitoring, and error-handling mechanisms.

Work with Power BI teams to provide curated and optimized datasets/models.

Implement security and governance using Microsoft Fabric capabilities and Microsoft Purview where applicable.

Optimize pipeline, Spark, SQL, and Warehouse performance.

Implement CI/CD and deployment processes using Azure DevOps/Git.





Troubleshoot production data pipelines and resolve data-related issues.

Collaborate with data architects, analysts, BI developers, and business stakeholders.

Required Skills Solid hands-on experience with Microsoft Fabric.

Experience With Fabric Data Factory / Pipelines

Lakehouse

Fabric Warehouse

Notebooks

Dataflows Gen2

OneLake

Spark / PySpark

SQL

Strong understanding of ETL/ELT concepts and data warehouse architecture.

Experience designing Bronze/Silver/Gold (Medallion) data architectures.

Strong programming skills in Python/PySpark and SQL.

Experience with relational databases such as SQL Server, Oracle, PostgreSQL, or similar.

Understanding of dimensional modeling, star schema, fact and dimension tables.

Experience with Git and Azure DevOps CI/CD.

Knowledge of data security, governance, and access control.

📌 MS Fabric Data Engineer (Hyderabad)
🏢 People Prime Worldwide
📍 Hyderabad