07 Aug
|
3shool Technology Consultants
|
Hyderabad
07 Aug
3shool Technology Consultants
Hyderabad
Role: Data Engineer Microsoft Fabric & Power BI
Location: Hyderabad (WFO)
Working hours: 04:30PM- 12:30AM
Notice Period: Immediate requirement.
Key Responsibilities
- Design and develop Fabric Pipelines for automated ingestion from APIs, files into OneLake.
- Implement medallion architecture (Bronze Silver Gold) using Fabric Lakehouses and Warehouses, applying Delta Lake best practices, partitioning, and incremental load patterns.
- Build dimensional (star schema) models in the Gold layer aligned to Student, Finance, HR, Learning, and Advising domains.
- Develop and maintain the master orchestration framework, including dependency management, retry logic, error handling, and scheduled execution windows.
- Implement data quality checks, validation rules, and reconciliation logic across layers; support certification of enterprise KPIs.
- Configure Row-Level Security (RLS) and Object-Level Security (OLS) in collaboration with the BI and security teams.
- Integrate with Microsoft Purview for metadata capture, lineage, classification, and business glossary alignment.
- Support deployment pipelines across Dev Test Prod Fabric workspaces, including CI/CD via Git integration.
- Collaborate with NWTC technical data stewards during sprint ceremonies, UAT, and hypercare.
- Produce technical documentation: source-to-target mappings, pipeline runbooks, and operational handover materials.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 5+ years of data engineering experience, with at least 2 years building on Microsoft Fabric, Azure Synapse, or Azure Data Factory.
- Hands-on expertise with OneLake, Lakehouse, Delta Lake, and Fabric Pipelines / Dataflows Gen2.
- Strong SQL and PySpark / Spark SQL skills for large-scale transformation workloads.
- Proven experience implementing medallion architecture and dimensional (Kimball-style) modeling.
- Working knowledge of Power BI semantic models, DirectLake/Import modes, and dataset refresh orchestration.
- Experience with source system integration patterns: REST APIs, OData, file-based ingestion, and CDC.
- Familiarity with Microsoft Purview, Entra ID, and Fabric workspace security models.
- Solid written and verbal communication; comfortable working directly with client stakeholders.
📌 Lead Data Engineer (Hyderabad)
🏢 3shool Technology Consultants
📍 Hyderabad