Senior Data Engineer

Experience: 7+ years

Location: Chennai / Pune / Bangalore / Hyderabad

Word Mode: 5 Days WFO

Mandatory Skills: Python, SQL, ETL, Oracle or SQL DB, Microsoft Fabric Lakehouse, Azure Synapse, Azure Data Factory, Medallion Architecture, Azure Data Lake, Storage Gen2, Ingestion, transformation, optimization, Record counts, load duration, failure tracking, incremental load and CDC logic.

1 Year of experience in Microsoft Fabric is mandatory.

Role Overview:

Data Engineer with 7+ years of experience in Cloud Technologies, Data Integration, and Data Migration. Experienced in designing and developing scalable ETL/ELT data pipelines using Azure Databricks, Azure Data Factory, PySpark, SQL, and Delta Lake. Strong expertise in implementing Medallion Architecture (Bronze, Silver, Gold), building Lakehouse solutions, and processing large-scale structured and semi-structured datasets. Skilled in optimizing data pipelines, implementing incremental data loading, performance tuning, and ensuring data quality across enterprise data platforms. Familiar with Microsoft Fabric Lakehouse concepts and modern cloud data engineering best practices.

Key Responsibilities





- Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
- Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
- Manage large-volume ingestion and backfill operations
- Implement Bronze to Silver transformation pipelines
- Develop incremental load and CDC logic
- Optimize Lakehouse performance and storage patterns
- Implement monitoring (record counts, load duration, failure tracking)
- Support Dev/Test/Prod promotion processes

Required Qualifications

- 7+ years of data engineering experience
- Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
- Robust experience with Fivetran or similar ELT tools
- Experience handling high-volume datasets (hundreds of millions of records)
- Proficiency in SQL, Python, and data modeling concepts
- Strong understanding of Medallion architecture.

Education: Bachelor's or Master's degree in Computer Science, Information Technology, Software Engineering, Data Science, or a related technical field.

📌 Senior Data Engineer (Bengaluru)
🏢 VIDPRO CONSULTANCY SERVICES
📍 Bengaluru