05 Nov
|
Technology next
|
Pune
05 Nov
Technology next
Pune
Job Title: Senior Data Engineer – Microsoft Fabric / Azure
Experience: 8+ Years
Employment Type: Full-Time
Work Location: Chennai / Pune / Bengaluru / Hyderabad
Work Mode: Hybrid
Working Hours: 2:00 PM – 11:00 PM IST
Job Summary
We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Microsoft Fabric, Azure Data Factory / Synapse, and Fivetran to support a critical enterprise data engineering engagement.
The ideal candidate will have experience designing and implementing scalable data ingestion and transformation pipelines, handling high-volume datasets, and optimizing enterprise data platforms using Microsoft Fabric Lakehouse architecture.
Candidates should have practical experience with Medallion Architecture (Bronze, Silver, and Gold layers), incremental data loading, Change Data Capture (CDC), and large-scale data processing.
Key Responsibilities
- Configure, develop, and optimize Fivetran connectors for enterprise data sources, including Oracle, SQL Server, and other databases.
- Design and implement large-scale data ingestion pipelines into Microsoft Fabric Lakehouse environments.
- Manage high-volume data ingestion, historical backfills, and data migration activities.
- Develop and maintain Bronze-to-Silver transformation pipelines using Microsoft Fabric and Azure services.
- Implement incremental data loading strategies and Change Data Capture (CDC) mechanisms.
- Design and optimize Lakehouse storage, data processing, and performance patterns.
- Work with Medallion Architecture to ensure efficient data organization and transformation across Bronze, Silver, and Gold layers.
- Develop monitoring and validation mechanisms covering record counts, load duration, data quality,
and pipeline failure tracking.
- Troubleshoot ingestion failures, pipeline issues, and performance bottlenecks.
- Support deployment and promotion of data solutions across Development, Testing, and Production environments.
- Collaborate with architects, analysts, and cross-functional teams to deliver reliable and scalable data solutions.
Mandatory Skills & Experience
- 8+ years of overall experience in Data Engineering.
- Minimum 1+ year of hands-on experience with Microsoft Fabric.
- Strong practical experience with Microsoft Fabric or Azure Synapse Analytics / Azure Data Factory.
- Hands-on experience with Fivetran or similar ELT tools.
- Experience configuring and managing data connectors for Oracle, SQL Server, and other enterprise data sources.
- Strong experience handling large-volume datasets involving hundreds of millions of records.
- Proficiency in SQL and Python.
- Strong understanding of data engineering principles and data modeling concepts.
- Hands-on experience with Medallion Architecture (Bronze, Silver, and Gold).
- Experience building incremental load pipelines and implementing CDC logic.
- Knowledge of data ingestion, transformation, monitoring, and performance optimization.
Positive to Have
- Microsoft Fabric Certification.
- Microsoft Azure Data Engineering Certification.
- Experience with enterprise-scale data migration and backfill operations.
- Experience with production deployments and Dev/Test/Prod environment management.
- Knowledge of Lakehouse architecture and data performance optimization.
Pay: ₹2,000,000.00 - ₹2,300,000.00 per year
Experience
- Data Engineering: 8 years (Required)
Work Location: Hybrid remote in Pune, Maharashtra
📌 Senior Data Engineer – Azure (Pune)
🏢 Technology next
📍 Pune