Hi

Position: Senior Data Engineer

Experience: 5–7Years

Location: Bangalore / Chennai / Hyderabad / Pune

Work Model: Hybrid (Mandatory 2 Days Work From Office)

Job Description

- Design and build Bronze, Silver, and Gold data pipelines using Microsoft Fabric and Databricks.
- Implement Cascade 1.0 & 2.0 merge logic in the Silver layer, including handling new and nulled columns.
- Migrate legacy SQL Server tables, views, and stored procedures into Microsoft Fabric Notebooks and Pipelines.
- Develop scalable PySpark transformations and Delta Lake models while optimizing performance and cost.
- Establish data quality checks, lineage, and source-to-target reconciliation.
- Collaborate with Report Engineers and QA teams to deliver governed semantic models.

Mandatory Skills

- Microsoft Fabric (Lakehouse, OneLake, Pipelines)
- PySpark
- SQL / T-SQL
- Delta Lake
- Azure Data Factory (ADF)
- Power BI (Datasets / Semantic Models)
- Databricks
- Medallion Architecture (Bronze / Silver / Gold)

Preferred Skills





- SQL Server
- SSIS / SQL Server ETL Migration
- Lakehouse Architecture
- Data Quality & Validation
- Performance Tuning

Candidate Requirements

- 5-7 years of overall IT experience with a minimum of 5+ years in Data Engineering.
- Hands-on expertise in Microsoft Fabric and/or Databricks.
- Robust experience in PySpark, SQL/T-SQL, Delta Lake, and Azure Data Factory.
- Experience migrating legacy SQL Server/SSIS ETL workloads to modern Lakehouse platforms is highly preferred.
- Good understanding of Power BI datasets and semantic models.
- Robust communication and stakeholder management skills.

Interview & Work Model

- Face-to-Face HR interview is mandatory.
- Candidate should be flexible to travel to the Chennai office whenever required for project-related work.

Skills:- databricks and Azure

📌 Senior Data Engineer (Bengaluru)
🏢 VY SYSTEMS PRIVATE
📍 Bengaluru