We're seeking a Senior Data Engineer with deep expertise in Microsoft Fabric to lead technical architecture and implementation of enterprise data solutions. You'll design end-to-end lakehouse architectures, optimize warehouse performance, build real-time analytics solutions, and mentor junior engineers.

Key Responsibilities

Architecture & Design (35%)

- Design lakehouse architectures leveraging Fabric’s OneLake, Warehouses, and Real-Time Analytics.
- Architect multi-domain Fabric solutions with solid data governance and medallion patterns.
- Define and optimize Warehouse schemas (star schema, snowflake schema) for analytics queries.
- Architect Real-Time Analytics solutions using KQL and streaming ingestion.
- Plan OneLake organization strategy including workspaces, folders, and shortcut architecture.
- Establish data governance frameworks using Fabric’s built-in features and external tools.

Development & Execution (35%)

- Develop complex ETL pipelines in Fabric Data Factory with advanced error handling.




- Optimize Warehouse queries using window functions, CTEs, and query hints.
- Build Spark notebooks for scalable data transformations with performance tuning.
- Implement Real-Time Analytics dashboards using Power BI and KQL.
- Design and enforce data quality frameworks with automated validation.
- Conduct code reviews and establish data engineering best practices.

Platform & DevOps (20%)

- Design CI/CD pipelines using Fabric’s deployment pipelines and Git integration.
- Optimize Fabric capacity planning and resource utilization.
- Implement security and access control with Fabric’s role-based access.
- Design disaster recovery and backup strategies for critical Fabric items.
- Manage monitoring and alerting for production Fabric workloads.

Pay: ₹1,200,000.00 - ₹1,880,000.00 per year

Benefits:

- Flexible schedule

Work Location: In person

📌 Senior Data Engineer (Bengaluru)
🏢 Innate Metrics Business Insights PvtLtd
📍 Bengaluru