12 Sep
|
Datavail Infotech
|
Mumbai
12 Sep
Datavail Infotech
Mumbai
Description
Title: Senior Data Engineer – Databricks & Fabric Engineering
Location: Hyderabad / Mumbai / Bangalore
Education: Bachelor's Degree
Experience: 5+ Years
Job Description
We are seeking an experienced Senior Data Engineer with robust expertise in Databricks, Microsoft Fabric, Data Engineering, Automation, and Data Quality Engineering. The ideal candidate will play a key role in designing, building, automating, and governing enterprise data platforms while ensuring the reliability, accuracy, and security of analytics solutions.
The role will support strategic data modernization initiatives across multiple clients and industry domains, focusing on scalable data pipelines, data quality frameworks, automation, and analytics platform engineering.
Key Responsibilities
- Design, develop, and maintain scalable data solutions using Databricks, Microsoft Fabric, SQL, Spark, and Delta Lake.
- Build and optimize data ingestion, transformation, and orchestration pipelines for enterprise data platforms.
- Develop and implement automation frameworks for data validation, testing,
monitoring, deployment, and operational support.
- Lead data engineering activities across the full lifecycle, including requirements, design, development, testing, deployment, and support.
- Build and maintain automated QA and reconciliation frameworks for analytical and reporting solutions.
- Validate data quality, completeness, consistency, and business rule compliance across enterprise datasets.
- Develop and maintain semantic models, lakehouses, warehouses, and data marts within Microsoft Fabric.
- Implement and validate security controls, including Row-Level Security (RLS) and data governance standards.
- Collaborate with business stakeholders, architects, analytics teams, and platform engineers to deliver enterprise-grade solutions.
- Support CI/CD, DevOps, Infrastructure-as-Code, and deployment automation initiatives.
- Drive performance optimization and cost efficiency across Databricks
📌 Senior Data Engineer (Mumbai)
🏢 Datavail Infotech
📍 Mumbai