26 Aug
|
Kastech
|
Hyderabad
Senior Data Engineer - Microsoft Fabric Power BI
Position Summary
We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, Power BI, and modern data engineering practices to lead the design, development, and implementation of an enterprise data platform. The ideal candidate will be responsible for building scalable data pipelines, implementing Medallion Architecture (Bronze, Silver, Gold), optimizing analytics workloads, and partnering closely with business stakeholders and client teams to deliver data-driven solutions.
This role requires a combination of hands-on technical expertise, solution architecture capabilities, stakeholder management, and strong client communication skills.
Experience
8+ years of Data Engineering experience with 3+ years in Azure/Fabric and strong Power BI implementation experience in enterprise-scale environments.
Key Responsibilities
Data Engineering Platform Development
- Design and implement scalable data platforms using Microsoft Fabric and OneLake .
- Develop and maintain data ingestion, transformation, and orchestration pipelines using Fabric Data Factory .
- Build and optimize PySpark/Spark notebooks for data processing and business transformations.
- Implement Medallion Architecture (Bronze, Silver, Gold) to support governed analytics.
- Design and implement metadata-driven ingestion frameworks and reusable engineering components.
- Develop incremental load strategies using watermarks, CDC, and change-tracking techniques.
- Build and manage SQL Warehouses and curated data models for business consumption.
- Implement data quality validations, reconciliation processes, and monitoring frameworks.
Power BI Analytics
- Design and optimize Power BI semantic models and datasets.
- Develop scalable star-schema data models and conformed dimensions.
- Create reusable measures, calculation groups, and reporting standards.
- Optimize Power BI reports using Direct Lake, Import, and Composite models.
- Reduce complex DAX logic by moving business transformations upstream into engineering layers.
- Implement Row-Level Security (RLS) and governance controls.
Architecture Governance
- Define enterprise data architecture standards and best practices.
- Implement data lineage, monitoring, observability, and governance frameworks.
- Establish Dev/Test/Prod deployment strategies and CI/CD pipelines.
- Manage security using RBAC, managed identities, and Azure Key Vault.
- Drive data governance initiatives including metadata management and auditability.
Client Stakeholder Engagement
- Act as the primary technical point of contact for client stakeholders.
- Conduct discovery workshops, requirements gathering sessions, and solution design discussions.
- Translate business requirements into scalable technical solutions.
- Present architecture recommendations, progress updates, and implementation roadmaps to leadership teams.
- Collaborate with business users, analysts, architects, and project managers across onshore and offshore teams.
- Provide technical mentorship and guidance to junior engineers.
Required Skills Experience
Microsoft Fabric
- 5+ years of data engineering experience with at least 2+ years in Microsoft Fabric.
- Strong experience with:
- Microsoft Fabric
- OneLake
- Fabric Data Factory
- Fabric Warehouses
- Lakehouse
- Dataflows Gen2
- Direct Lake
- Deployment Pipelines
- Fabric Monitoring and Governance
Data Engineering
- Robust expertise in:
- PySpark
- Apache Spark
- SQL
- Data Modeling
- ETL/ELT Development
- Metadata-Driven Frameworks
- Data Quality Management
- Incremental Loads and CDC
- Watermark-Based Processing
- Performance Optimization
Power BI
- Enterprise Power BI architecture and development.
- Semantic model design.
- Star schema and dimensional modeling.
- DAX optimization.
- Row-Level Security (RLS).
- Power BI Administration and Governance.
Azure Ecosystem
Experience with:
- Azure Data Lake Storage (ADLS)
- Azure Key Vault
- Azure DevOps
- Microsoft Entra ID
- Azure Monitor
- Git-based CI/CD practices
Data Governance Security
- Data lineage and observability.
- RBAC and access management.
- Data privacy and PII masking.
- Production support and platform monitoring.
Client-Facing Soft Skills
The ideal candidate must demonstrate:
- Strong client communication and presentation skills.
- Experience leading architecture and design discussions with senior stakeholders.
- Ability to explain technical concepts to business audiences.
- Experience conducting workshops, requirements sessions, and knowledge transfer sessions.
- Strong documentation and solution design skills.
- Ability to independently manage client interactions and stakeholder expectations.
- Experience working in global delivery models with onshore and offshore teams.
Preferred Qualifications
- Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Microsoft Power BI Data Analyst Associate (PL-300)
- Experience with Dataverse, Dynamics 365, and Power Platform data integration.
- Experience migrating from Synapse, Data Lake, or legacy BI platforms to Microsoft Fabric.
Nice-to-Have Experience
- Dynamics 365 / Dataverse analytics.
- Metadata-driven accelerator frameworks.
- Enterprise data governance programs.
- AI/Copilot integration with Fabric and Power BI.
- Manufacturing, Operations, or ERP analytics environments.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Senior Data Engineer (Hyderabad)
🏢 Kastech
📍 Hyderabad