13 Aug
|
Covai Sprouts Talent Scout
|
Chennai
13 Aug
Covai Sprouts Talent Scout
Chennai
We are looking for an experienced Senior Data Engineer to join our data engineering team on a contract basis. The ideal candidate will have strong expertise in Microsoft Fabric, Azure Synapse, Azure Data Factory, Fivetran, and enterprise-scale data engineering.
You will be responsible for designing, implementing, and optimizing data ingestion and transformation pipelines while ensuring high performance, scalability, and reliability across enterprise data platforms.
Key Responsibilities
- Design and implement enterprise data ingestion pipelines into Microsoft Fabric Lakehouse.
- Configure and optimize Fivetran connectors for Oracle, SQL Server, and other enterprise data sources.
- Manage large-scale data ingestion, backfill, and incremental loading processes.
- Develop Bronze, Silver, and Gold transformation pipelines using Medallion Architecture.
- Implement Change Data Capture (CDC) and incremental data loading strategies.
- Optimize Lakehouse storage, query performance, and data partitioning.
- Develop monitoring solutions for pipeline execution, record counts, load duration,
and failure tracking.
- Support Dev, Test, and Production deployment processes.
- Collaborate with Data Architects, BI teams, and business stakeholders.
- Troubleshoot and resolve data pipeline issues while ensuring data quality.
Required Skills
- 7+ years of Data Engineering experience.
- Strong hands-on experience with Microsoft Fabric.
- Experience with Azure Synapse Analytics or Azure Data Factory.
- Experience with Fivetran or similar ELT tools.
- Robust SQL programming skills.
- Python development experience.
- Data Modeling experience.
- Experience handling high-volume datasets (hundreds of millions of records).
- Strong understanding of Medallion Architecture (Bronze, Silver, Gold).
- Experience implementing CDC (Change Data Capture) and incremental loading.
- Excellent analytical and troubleshooting skills.
Preferred Skills
- Experience with Delta Lake.
- Azure Data Lake Storage
📌 Senior Data Engineer (Chennai)
🏢 Covai Sprouts Talent Scout
📍 Chennai