We are seeking a Senior Data Engineer with strong Microsoft Fabric expertise and hands on PySpark skills to lead the migration of analytics and data engineering workloads into the Fabric ecosystem You will assess currentstate platforms design futurestate architecture on Fabric Lakehouse Warehouse Data Factory RealTime Analytics Power BI integration and drive end to end migration performance tuning and operational readiness
Key Responsibilities
Own end to end migration of data pipelines models and analytical workloads into Microsoft Fabric
Assess existing estates eg ADF Synapse Databricks Snowflake on prem and define migration strategy roadmap and cutover plans
Design and implement Fabric Lakehouse architectures DeltaMedallion Warehouses and Data Engineering pipelines using Data Factory Dataflows Gen2 and Notebooks
Build and optimize PySparkSQL code for ingestion transformation and enrichment on Fabric Spark
Establish CICD and DevOps practices for Fabric Git integration environments deployment pipelines
Implement data governance security and compliance workspaces capacities permissions Purview lineage where applicable
Set up monitoring observability and costcapacity management tune pipelines and queries for performance and reliability
Partner with BI teams on Power BI datasetsmodels and ensure performant end to end analytics
Lead testing and validation schema mapping data quality checks reconciliation and coordinate cutover and hypercare
Document architecture patterns and runbooks enable and mentor engineering and analytics teams on Fabric best practices
Engage stakeholders manage risks and communicate progress to technical and business audiences
Required Qualifications
6 years in data engineeringanalytics with a strong track record migrating workloads to modern cloud platforms
12 years working with Microsoft Fabric components or equivalent experience in SynapseDatabricks plus proven Fabric adoption
Robust PySpark development skills for ETLELT optimization and troubleshooting
Advanced SQL T SQLANSI SQL deltapartitioning strategies and LakehouseMedallion architecture
Hands on with Fabric features Lakehouse Warehouse Data Engineering NotebooksSpark Data Factory Dataflows Gen2 OneLake and Git integration
Solid understanding of Power BI integration with Fabric datasets Direct Lake semantic models
Experience with Azure ecosystem ADLSOneLake concepts Entra ID Azure AD Key Vault Event HubEventstream nice networkingsecurity basics
CICD with Azure DevOps or GitHub environment promotion and release management
Strong stakeholder management planning and communication ability to lead cross functional migration efforts
Bachelors in Computer Science Engineering or related field or equivalent experience
PreferredGood to Have
Microsoft Certified Fabric Analytics Engineer Associate DP 600 andor Azure Data Engineer Associate DP 203
Prior migrations from SynapseADFDatabricksSnowflakeon prem SSISSQL Server into Fabric
DAXPower BI modeling familiarity for end to end solutioning
IaC exposure BicepTerraform for Azure services where applicable scripting in PythonPowerShell
Experience with AgileScrum and working in product centric teams Skills :
- Mandatory Skills : Databricks, Microsoft Fabric - Data Engineering, PySpark-Data Science About LTM
📌 Senior Specialist - Data Engineering (India)
🏢 LTM
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.