03 Sep
|
TRIGENT SOFTWARE PRIVATE
|
Bengaluru
03 Sep
TRIGENT SOFTWARE PRIVATE
Bengaluru
Key Responsibilities for MS fabric :
- Design, build, and maintain end-to-end data pipelines and reporting solutions using Microsoft Fabric components including Lakehouse, Warehouse, and Notebooks.
- Develop scalable data ingestion, transformation, and migration pipelines using PySpark, Spark SQL, and Fabric Data Engineering workloads.
- Migrate and integrate data from legacy systems and on premise SQL Server into Fabric OneLake ensuring data accuracy and consistency.
- Build and optimize Fabric Dataflows Gen2 and Pipelines for batch and scheduled data processing.
- Develop and enhance Power BI semantic models, datasets, and dashboards for actionable insights across enterprise domains.
- Perform advanced SQL and PySpark transformations for data cleansing, deduplication, enrichment, and normalization.
- Manage schema evolution, missing data logic, and data type standardization across Lakehouse and Warehouse layers.
- Implement data validation, reconciliation,
and quality checks to ensure high data reliability and stakeholder trust.
- Support continuous data onboarding and migration cycles, troubleshooting data quality, audit, and refresh issues.
- Operationalize pipelines for daily and weekly refresh cycles, monitor execution, and ensure SLA adherence.
Mandatory skills*
MS fabric, ADF, PySpark, Spark SQL
Additional Details
- Project Location 1 : MAH | PUNE
- Project Location 2 : KRNK | Bengaluru
- Relevant Experience : 4+ years
- Mandatory skills : MS fabric, ADF, PySpark, Spark SQL
- Desired skills : PowerBI
- Domain (Industry) : MFG
- Total Experience (Ex. 5-7 Years) : 7+ years
- WFO / WFH / Hybrid : Hybrid
- Please enter shift timings : Afternoon Shift
- Shift Timings : Afternoon
📌 Senior Data Engineer || Bengaluru & Pune || Hybrid
🏢 TRIGENT SOFTWARE PRIVATE
📍 Bengaluru