13 Aug
|
MindBrain
|
Hyderabad
13 Aug
MindBrain
Hyderabad
Job Title: Senior Data Engineer
Experience:
7+ Years
Location:
Chennai / Pune / Bangalore / Hyderabad
Work Mode:
Work From Office (WFO)
Employment Type:
Full-Time
Shift:
UK Shift (2:00 PM – 11:00 PM IST)
Interview Process:
Assessment + 2 Technical Interview Rounds
Job Summary
We are seeking an experienced
Senior Data Engineer
with strong expertise in Microsoft Fabric, Azure Data Engineering technologies, and modern ELT frameworks. The ideal candidate will have hands-on experience designing and building scalable data pipelines, optimizing large-scale data ingestion, implementing Medallion Architecture, and working with enterprise data platforms. Experience with Microsoft Fabric and Databricks is mandatory.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Microsoft Fabric Lakehouse.
- Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
- Configure, manage, and optimize Fivetran connectors (Oracle, SQL Server, SQL Database, and other enterprise sources).
- Manage high-volume data ingestion, historical backfills, and incremental data loads.
- Develop Bronze-to-Silver transformation pipelines following Medallion Architecture.
- Implement Change Data Capture (CDC) and incremental loading strategies.
- Optimize Lakehouse storage, partitioning, and query performance.
- Build and maintain robust monitoring for data pipelines, including record validation, load duration, and failure tracking.
- Support deployment and promotion across Development, Testing, and Production environments.
- Collaborate with data architects, analysts, and business stakeholders to deliver reliable data solutions.
- Ensure data quality, governance, scalability, and performance best practices.
Required Skills & Qualifications
- 7+ years of experience in Data Engineering.
- Hands-on experience with
Microsoft Fabric
,
Azure Synapse Analytics
, or
Azure Data Factory
.
- Solid experience
📌 Senior Data Engineer (Hyderabad)
🏢 MindBrain
📍 Hyderabad