Lead Data Engineer (Hyderabad)

Lead Data Engineer (Hyderabad)

07 Aug
|
3shool Technology Consultants
|
Hyderabad

07 Aug

3shool Technology Consultants

Hyderabad

Role: Data Engineer Microsoft Fabric & Power BI

Location: Hyderabad (WFO)

Working hours: 04:30PM- 12:30AM

Notice Period: Immediate requirement.

Key Responsibilities

- Design and develop Fabric Pipelines for automated ingestion from APIs, files into OneLake.
- Implement medallion architecture (Bronze Silver Gold) using Fabric Lakehouses and Warehouses, applying Delta Lake best practices, partitioning, and incremental load patterns.
- Build dimensional (star schema) models in the Gold layer aligned to Student, Finance, HR, Learning, and Advising domains.
- Develop and maintain the master orchestration framework, including dependency management, retry logic, error handling, and scheduled execution windows.
- Implement data quality checks, validation rules, and reconciliation logic across layers; support certification of enterprise KPIs.
- Configure Row-Level Security (RLS) and Object-Level Security (OLS) in collaboration with the BI and security teams.
- Integrate with Microsoft Purview for metadata capture, lineage, classification, and business glossary alignment.
- Support deployment pipelines across Dev Test Prod Fabric workspaces, including CI/CD via Git integration.




- Collaborate with NWTC technical data stewards during sprint ceremonies, UAT, and hypercare.
- Produce technical documentation: source-to-target mappings, pipeline runbooks, and operational handover materials.

Required Qualifications

- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 5+ years of data engineering experience, with at least 2 years building on Microsoft Fabric, Azure Synapse, or Azure Data Factory.
- Hands-on expertise with OneLake, Lakehouse, Delta Lake, and Fabric Pipelines / Dataflows Gen2.
- Strong SQL and PySpark / Spark SQL skills for large-scale transformation workloads.
- Proven experience implementing medallion architecture and dimensional (Kimball-style) modeling.
- Working knowledge of Power BI semantic models, DirectLake/Import modes, and dataset refresh orchestration.
- Experience with source system integration patterns: REST APIs, OData, file-based ingestion, and CDC.
- Familiarity with Microsoft Purview, Entra ID, and Fabric workspace security models.
- Solid written and verbal communication; comfortable working directly with client stakeholders.

📌 Lead Data Engineer (Hyderabad)
🏢 3shool Technology Consultants
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (hyderabad) / hyderabad