31 Jul
|
EXL Services
|
India
31 Jul
EXL Services
India
Role Overview :
We are seeking a highly skilled Microsoft Fabric Data Engineer to design, develop, and maintain modern data platforms leveraging Microsoft Fabric. The ideal candidate should have hands-on experience with OneLake, Lakehouse, Data Factory, Data Pipelines, PySpark, SQL, and Medallion Architecture to support enterprise-scale analytics and reporting requirements.
Key Responsibilities :
Data Engineering &
- Integration :
- Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric.
- Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines.
- Integrate data from multiple sources including databases, APIs, flat files, cloud storage, and SaaS applications.
- Implement incremental data loads and Change Data Capture (CDC) strategies.
Lakehouse Development :
- Design and maintain Fabric Lakehouse environments.
- Develop and optimize Delta Tables for high-performance analytics workloads.
- Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance requirements.
- Create curated datasets for reporting, analytics, and AI/ML use cases.
Data Transformation &
- Processing :
- Develop data transformation logic using PySpark, Spark SQL, and notebooks.
- Create reusable frameworks and data engineering best practices.
- Perform data cleansing, enrichment, and standardization activities.
Data Modeling &
- Analytics Support :
- Design dimensional and analytical data models.
- Collaborate with Business Intelligence teams to support Power BI semantic models and reporting requirements.
- Ensure data consistency, quality, and accuracy across data platforms.
Performance Optimization &
- Governance :
- Monitor data pipeline performance and troubleshoot production issues.
- Optimize Spark jobs, Lakehouse storage, and query performance.
- Implement security controls, role-based access, and data governance standards.
- Support data lineage, auditing, and compliance requirements.
DevOps &
- Collaboration :
- Implement CI/CD processes using Git integration and deployment pipelines.
- Participate in Agile ceremonies and collaborate with architects, analysts, and business stakeholders.
- Maintain technical documentation and operational runbooks.
Required Skills :
Technical Skills :
- Microsoft Fabric
- OneLake
- Fabric Lakehouse
- Fabric Data Factory
- Data Pipelines
- Notebook Development
- PySpark
- Spark SQL
- SQL
- Delta Lake
- Medallion Architecture
- Power BI Integration
- Git Version Control
Cloud &
- Data Platform Experience :
- Azure Data Services
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics (preferred)
- Azure DevOps
Data Engineering Concepts :
- ETL/ELT Development
- Data Modeling
- Data Warehousing
- Data Governance
- Data Quality Frameworks
- Performance Tuning
Preferred Qualifications :
- Experience in large-scale enterprise data transformation programs.
- Knowledge of Data Mesh and Up-to-date Data Platform concepts.
- Exposure to AI/ML data preparation processes.
- Microsoft Fabric Certification (Preferred).
- Experience working in Banking, Insurance, Healthcare, or Retail domains.
📌 EXL - Microsoft Fabric Data Engineer (India)
🏢 EXL Services
📍 India