08 Oct
|
LATENTVIEW ANALYTICS
|
Hyderabad
08 Oct
LATENTVIEW ANALYTICS
Hyderabad
Role Summary:
We are looking for a Fabric Data Engineer with 7+ years of experience to drive the technical execution of enterprise data platform initiatives using Microsoft Fabric. The role involves designing and building scalable data pipelines, implementing Lakehouse and Medallion Architecture, leading migration initiatives, optimizing Fabric workloads, and providing technical guidance to a team of data engineers.
Roles & Responsibilities
• Lead the design, development, and deployment of scalable data pipelines using Microsoft Fabric Data Factory, Dataflows Gen2, and Spark Notebooks.
• Implement and optimize Medallion Architecture (Bronze/Silver/Gold) using Delta Lake, OneLake, schema evolution, and partitioning strategies.
• Drive data migration and integration from Azure Synapse, SQL Server, Databricks, and Snowflake into Microsoft Fabric.
• Build batch, streaming, and real-time data pipelines using Fabric Real-Time Intelligence, Eventstreams, KQL Database, and Eventhouse.
• Design and optimize data models and Power BI semantic layers, leveraging Direct Lake, Import,
and DirectQuery for high-performance analytics.
• Establish data governance, security, CI/CD, Git integration, automated testing, and deployment standards, including Microsoft Purview for lineage and cataloging.
• Provide technical leadership and mentorship to data engineers through code reviews, architectural guidance, documentation, and engineering best practices.
Required Skills
• 7+ years of experience in Data Engineering, Data Platform Development, or ETL Architecture.
• 1.5+ years of hands-on experience with Microsoft Fabric.
• Strong hands-on expertise in Microsoft Fabric, OneLake, Lakehouse, Warehouse, Data Factory, and Real-Time Intelligence.
• Strong programming skills in Python/PySpark and SQL/T-SQL.
• Knowledge of M, PowerShell, or Azure CLI.
• Robust understanding of Apache Spark, Delta Lake, Medallion Architecture, data lakehouse patterns, partitioning, and performance optimization.
📌 Assistant Manager (Hyderabad)
🏢 LATENTVIEW ANALYTICS
📍 Hyderabad