We are looking for an experienced Data Engineer with strong expertise in Microsoft Fabric, Azure Databricks, and contemporary Lakehouse architecture. The ideal candidate will be responsible for designing, building, and optimizing scalable enterprise data platforms, developing robust data pipelines, and enabling analytics solutions that support business decision-making.
Key Responsibilities:
1. Data Engineering:
- Design and develop scalable ETL/ELT and data ingestion pipelines.
- Build enterprise-grade data transformation frameworks and reusable engineering components.
- Implement Lakehouse architecture using Microsoft Fabric and Azure Databricks.
- Ensure data quality, validation, governance, and performance optimization.
- Develop automated data processing workflows and engineering best practices.
1. Microsoft Fabric:
Develop end-to-end solutions using:
- Microsoft Fabric Data Factory
- Fabric Lakehouse
- Fabric Warehouse
- Fabric Notebooks
- Semantic Models
- Dataflows
1. Azure Databricks:
- Design and optimize Spark-based data pipelines.
- Develop and maintain Delta Lake tables and enterprise ETL processes.
- Implement workflow orchestration, data quality, and performance optimization using PySpark, Spark SQL, Delta Lake, and Unity Catalog.
1. Analytics & BI Enablement:
- Develop dbt models and transformation workflows.
- Support business-ready datasets, semantic models, and optimized data marts.
- Collaborate with Power BI teams to improve reporting performance and analytics capabilities.
1. Engineering Best Practices:
- Follow coding standards, Git version control, CI/CD practices, documentation, and code review processes.
- Drive performance tuning, reusable framework development, and technical knowledge sharing.
Required Technical Skills:
SQL / Python /
📌 Senior Data Engineer (Mumbai)
🏢 LDS Infotech
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.