08 Aug
|
3shool Technology Consultants
|
Hyderabad
08 Aug
3shool Technology Consultants
Hyderabad
Role: Data Engineer Microsoft Fabric & Power BI
Location: Hyderabad (WFO)
Working hours: 04:30PM- 12:30AM
Notice Period: Immediate requirement.
Key Responsibilities
Design and develop Fabric Pipelines for automated ingestion from APIs, files into OneLake.
Implement medallion architecture (Bronze Silver Gold) using Fabric Lakehouses and Warehouses, applying Delta Lake best practices, partitioning, and incremental load patterns.
Build dimensional (star schema) models in the Gold layer aligned to Student, Finance, HR, Learning, and Advising domains.
Develop and maintain the master orchestration framework, including dependency management, retry logic, error handling, and scheduled execution windows.
Implement data quality checks, validation rules, and reconciliation logic across layers; support certification of enterprise KPIs.
Configure Row-Level Security (RLS) and Object-Level Security (OLS) in collaboration with the BI and security teams.
Integrate with Microsoft Purview for metadata capture, lineage, classification, and business glossary alignment.
Support deployment pipelines across Dev Test Prod Fabric workspaces, including CI/CD via Git integration.
Collaborate with NWTC technical data stewards during sprint ceremonies, UAT, and hypercare.
Produce technical documentation: source-to-target mappings, pipeline runbooks, and operational handover materials.
Required Qualifications
Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
5+ years of data engineering experience, with at least 2 years building on Microsoft Fabric, Azure Synapse, or Azure Data Factory.
Hands-on expertise with OneLake, Lakehouse, Delta Lake, and Fabric Pipelines / Dataflows Gen2.
Solid SQL and PySpark / Spark SQL skills for large-scale transformation workloads.
Proven experience implementing medallion architecture and dimensional (Kimball-style) modeling.
Working knowledge of Power BI semantic models, DirectLake/Import modes, and dataset refresh orchestration.
Experience with source system integration patterns: REST APIs, OData, file-based ingestion, and CDC.
Familiarity with Microsoft Purview, Entra ID, and Fabric workspace security models.
Solid written and verbal communication; comfortable working directly with client stakeholders.
📌 Lead Data Engineer Hyderabad
🏢 3shool Technology Consultants
📍 Hyderabad