Senior Data Engineer

Experience: 7+ years

Location: Chennai / Pune / Bangalore / Hyderabad

Word Mode: 5 Days WFO

Mandatory Skills: Python, SQL, ETL, Oracle or SQL DB, Microsoft Fabric Lakehouse, Azure Synapse, Azure Data Factory, Medallion Architecture, Azure Data Lake, Storage Gen2, Ingestion, transformation, optimization, Record counts, load duration, failure tracking, incremental load and CDC logic.

1 Year of experience in Microsoft Fabric is mandatory.

Role Overview:

Data Engineer with 7+ years of experience in Cloud Technologies, Data Integration, and Data Migration. Experienced in designing and developing scalable ETL/ELT data pipelines using Azure Databricks, Azure Data Factory, PySpark, SQL, and Delta Lake. Robust expertise in implementing Medallion Architecture (Bronze, Silver, Gold), building Lakehouse solutions, and processing large-scale structured and semi-structured datasets. Skilled in optimizing data pipelines, implementing incremental data loading, performance tuning, and ensuring data quality across enterprise data platforms. Familiar with Microsoft Fabric Lakehouse concepts and modern cloud data engineering best practices.

Key Responsibilities




Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
Manage large-volume ingestion and backfill operations
Implement Bronze to Silver transformation pipelines
Develop incremental load and CDC logic
Optimize Lakehouse performance and storage patterns
Implement monitoring (record counts, load duration, failure tracking)
Support Dev/Test/Prod promotion processes

Required Qualifications
7+ years of data engineering experience
Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
Robust experience with Fivetran or similar ELT tools
Experience handling high-volume datasets (hundreds of millions of records)
Proficiency in SQL, Python, and data modeling concepts
Robust understanding of Medallion architecture.

Education: Bachelor's or Master's degree in Computer Science, Information Technology, Software Engineering, Data Science, or a related technical field.

📌 Senior Data Engineer Bengaluru
🏢 VIDPRO CONSULTANCY SERVICES
📍 Bengaluru