05 Oct
|
HMG America
|
Bengaluru
05 Oct
HMG America
Bengaluru
Job Title: Microsoft Fabric Data Engineer
Experience: 5 + Years
Location: Bangalore, Pune, Noida , Mumbai , Chennai
( Immediate joiner prefer )
Job Summary
We are looking for an experienced Microsoft Fabric Data Engineer with strong hands-on experience in Microsoft Fabric, OneLake, Lakehouse, Data Factory, PySpark, Python, SQL, and Azure data services. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data platforms using Microsoft Fabric.
Key Responsibilities
- Design and develop scalable data engineering solutions using Microsoft Fabric.
- Build and maintain data pipelines using Fabric Data Factory / Data Pipelines.
- Develop and manage Fabric Lakehouse and OneLake solutions.
- Perform data ingestion, transformation, cleansing, and integration from multiple sources.
- Develop data processing solutions using Apache Spark, PySpark, and Python.
- Write optimized SQL queries for data transformation, validation, and analysis.
- Work with Delta Lake and implement reliable and scalable data storage solutions.
- Develop ETL/ELT workflows and implement incremental data loading strategies.
- Integrate data from Azure services, databases, APIs, files, and other enterprise sources.
- Optimize data pipelines and Spark workloads for performance and cost efficiency.
- Implement data quality, validation, monitoring, and error-handling mechanisms.
- Work closely with Data Architects, Analysts, Data Scientists, and business stakeholders.
- Support data migration and modernization initiatives from legacy/Azure/Databricks platforms to Microsoft Fabric.
- Implement security, access control, and governance following organizational standards.
- Troubleshoot production data pipelines and resolve performance or data-quality issues.
Mandatory Skills
- Robust hands-on experience with Microsoft Fabric
- OneLake
- Fabric Lakehouse
- Fabric Data Factory / Data Pipelines
- PySpark
- Python
- SQL
- Apache Spark
- Delta Lake
- Strong understanding of ETL/ELT concepts
- Experience developing and optimizing data pipelines
- Good understanding of data modeling and modern data architecture
Good to Have
- Experience with Azure Data Factory
- Azure Data Lake Storage (ADLS)
- Databricks
- Azure Synapse Analytics
- Power BI
- Microsoft Purview
- Git / Azure DevOps
- CI/CD
- Experience with real-time/streaming data
- Microsoft Fabric or Azure data certifications
📌 Microsoft Fabric Data Engineer (Bengaluru)
🏢 HMG America
📍 Bengaluru