Job Description:

- Design, develop, and maintain scalable Microsoft Fabric data engineering solutions using Fabric Lakehouse, Data Warehouse, Data Factory, and related services.

- Build and manage up-to-date data platforms leveraging Microsoft One Lake as a centralized data lake.

- Develop robust ETL/ELT pipelines for batch and near-real-time data ingestion from various enterprise and cloud sources.

- Implement Medallion Architecture (Bronze, Silver, Gold) for structured and governed data processing.

- Develop data transformation and processing solutions using PySpark, Spark SQL, SQL, and other relevant technologies.

- Design and implement data pipelines using Microsoft Fabric Data Factory and Azure Data Factory (ADF).

- Integrate data from multiple sources including relational databases, APIs, files, cloud applications, and enterprise systems.

- Work with Fabric Lakehouse, Warehouse, Dataflows Gen2, Notebooks, Pipelines, and semantic models to deliver end-to-end analytics solutions.

- Develop and optimize data solutions using Databricks and Snowflake where required.

- Implement data quality, validation, monitoring,



and reconciliation processes across data pipelines.

- Apply data governance, security, access control, lineage, and compliance best practices.

- Work with Microsoft Purview and related governance capabilities to support data cataloging, classification, lineage, and discovery.

- Optimize data pipelines, Spark workloads, SQL queries, storage, and compute resources for improved performance and cost efficiency.

- Implement monitoring, logging, error handling, alerting, and recovery mechanisms for production data pipelines.

- Collaborate with Data Architects, BI Developers, Data Scientists, Business Analysts, and other stakeholders to understand requirements and deliver scalable data solutions.

- Participate in architecture discussions, technical design, code reviews, testing, deployment, and production support.

- Follow CI/CD and Dev Ops practices for data engineering development and deployment.

- Troubleshoot complex data pipeline, integration, performance, and production issues.

📌 Microsoft Fabric Data Engineer (India)
🏢 Acme Services Private
📍 India