24 Oct
|
RapidBrains
|
Chennai
24 Oct
RapidBrains
Chennai
We are seeking an experienced Senior Data Engineer with 6+ years of experience to lead data ingestion, transformation, and optimization initiatives within Microsoft Fabric Lakehouse environments. The candidate will be responsible for enterprise data integration, ELT pipeline development, high-volume data processing, and implementation of scalable data solutions.
Key Responsibilities
- Manage end-to-end development of enterprise data ingestion and transformation pipelines.
- Implement Microsoft Fabric Lakehouse solutions using Medallion architecture.
- Configure and optimize Fivetran connectors for Oracle, SQL Server, and other data sources.
- Develop incremental loading, CDC, and large-scale data backfill processes.
- Optimize Lakehouse performance, data storage, and processing workflows.
- Implement pipeline monitoring, data quality checks, and failure tracking.
- Manage Dev/Test/Prod deployments and production support.
- Collaborate with cross-functional teams to ensure reliable and scalable data delivery.
Required Skills
- 6+ years of experience in Data Engineering.
- Hands-on experience with Microsoft Fabric or Azure Synapse Analytics / Azure Data Factory.
- Strong experience with Fivetran or similar ELT tools.
- Proficiency in SQL and Python.
- Robust knowledge of Lakehouse and Medallion architecture (Bronze, Silver, Gold).
- Experience with CDC, incremental loading, and high-volume data processing.
- Knowledge of Oracle, SQL Server, data modeling, and pipeline optimization.
- Experience with monitoring, troubleshooting, and deployment processes.
📌 Senior Data Engineer (Chennai)
🏢 RapidBrains
📍 Chennai