14 Nov
|
Celebal Technologies
|
Jaipur
14 Nov
Celebal Technologies
Jaipur
Job Summary : We are looking for an experienced Azure Data Engineer with strong Microsoft Fabric expertise to design, develop, and optimize modern data and analytics solutions.The role requires hands-on experience across Fabric Lakehouse, Warehouse, OneLake, Data Factory, PySpark, Power BI, DAX, semantic models, and Data Agents.The ideal candidate should be strong in both data engineering and analytics, with a particular focus on performance optimization, scalable data modeling, and AI-enabled data solutions.Key Responsibilities : - Design and develop scalable ETL/ELT pipelines using Microsoft Fabric Data Factory, Dataflows Gen2, SQL, Python, and PySpark.- Build and optimize Lakehouse, Warehouse, OneLake, and Delta Lake solutions using Bronze/Silver/Gold architecture.- Develop complex T-SQL queries, views, transformations, and dimensional data models using star schema, fact/dimension tables, and SCD.- Develop and optimize Power BI semantic models, DAX measures, Power Query, and reports.- Implement and optimize Direct Lake models while minimizing unnecessary DirectQuery fallback.- Design and maintain Fabric Data Agents and validate AI-generated SQL, PySpark, and DAX using Copilot/Fabric AI capabilities.- Perform end-to-end performance tuning across Spark/PySpark, SQL Warehouse, Delta tables, Data Factory, Power BI, DAX, and Fabric capacity.- Optimize Delta tables using appropriate partitioning, OPTIMIZE, VACUUM, and V-Order strategies.- Monitor workloads using Spark UI, Query Insights, Monitoring Hub,
and Capacity Metrics.- Implement CI/CD using Git/Azure DevOps/GitHub and Fabric deployment pipelines.- Apply security and governance using Microsoft Entra ID, workspace roles, OneLake security, and Microsoft Purview.- Collaborate with analysts, BI developers, data scientists, and business stakeholders to deliver production-ready data solutions.Required Skills : - 4+ years of experience in Azure Data Engineering.- Strong hands-on experience with Microsoft Fabric.- Advanced SQL/T-SQL skills.- Robust Python and PySpark experience.- Strong knowledge of Lakehouse, Warehouse, OneLake, Delta Lake, and Medallion Architecture.- Strong Power BI, DAX, semantic modeling, and Power Query skills.- Experience with Direct Lake and Power BI performance optimization.- Experience with Data Factory and Dataflows Gen2.- Strong understanding of data modeling and performance tuning.- Experience with Git, CI/CD, and deployment pipelines.- Understanding of data security, governance, and monitoring.Good to Have : - Hands-on experience building Microsoft Fabric Data Agents.- Experience with Copilot, Azure OpenAI, MLflow, or MLOps.- Knowledge of Microsoft Purview.- Experience with Real-Time Intelligence, Eventstreams, Eventhouse, or KQL.- Experience with Azure SQL, Snowflake, S3, or other external data sources.- Microsoft Fabric/Azure Data Engineering certification.Education : Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field (ref:hirist.tech)
📌 Celebal Technologies - Azure Data Engineer - Microsoft Fabric (Jaipur)
🏢 Celebal Technologies
📍 Jaipur