27 Sep
|
XCentium
|
Madhya Pradesh
27 Sep
XCentium
Madhya Pradesh
Job Type: Full-time
Remote: Remote
Senior Data Engineer — Microsoft Fabric & DatabricksXCentium — India (Remote)This is a Full-Time Remote position with a flexible work environment and outstanding benefits! Apply today!About UsXCentium is an award-winning digital consultancy focused on DX, UX, Content, Commerce, CRM, Service and Cloud. We primarily work on Sitecore, Salesforce, Optimizely and Microsoft platforms.XCentium is a leader in Salesforce Commerce, Salesforce B2B Commerce, OMS, CRM, Service, Marketing, Experience and MuleSoft and first company to achieve Salesforce Master Navigator for B2B Commerce globally.We are a team of highly dedicated individuals, successful at delivering creative, new ideas that drive change for us and our clients. We build with heart, lead with excellence, and guide with expertise. Our team is growing, and we would love to hear from you!Job DescriptionXCentium is seeking a Senior Data Engineer with deep hands-on expertise in Microsoft Fabric and/or Databricks to join our data practice. In this role, you will own the end-to-end implementation of complex data pipelines and lakehouse components, translate architectural designs into production-grade solutions, and provide technical guidance to junior engineers.You will work closely with data architects and client stakeholders to build ingestion, transformation, data quality, and semantic modeling layers, and take the lead on performance optimization and engineering best practices across the medallion tiers. You'll play a key role in proof-of-concepts, accelerators, and enterprise-scale implementations, often serving as the senior technical presence on client engagements.Core Qualifications6+ years in data engineering or enterprise data platform rolesStrong hands-on experience with Microsoft Fabric (OneLake, Lakehouse, Data Factory, Eventstream, KQL Database) and/or Databricks (Workflows, Unity Catalog,
Delta Live Tables)Strong proficiency with Delta Lake format and its role across Lakehouse tiersExperience supporting Power BI / DirectLake connectivity or other BI tools consuming Gold-layer dataMedallion Architecture ImplementationAbility to implement layer-specific data handling: raw ingestion at Bronze, cleansing/validation at Silver, and business-ready modeling at GoldExperience building star schemas in the Gold layer for BI consumptionHands-on experience implementing CDC (Change Data Capture) patterns within the medallion frameworkData Engineering & IntegrationStrong proficiency with PySpark / Spark Structured Streaming (within Fabric notebooks and/or Databricks notebooks)Experience building ingestion pipelines using Azure Data Factory, Dataflows Gen2, or Databricks Workflows/AutoloaderFamiliarity with source systems such as Salesforce, Oracle Service Cloud, Profisee (or similar MDM platforms)Understanding of real-time vs. batch ingestion path design (Eventstream, Spark Structured Streaming vs. scheduled pipelines)Experience with performance tuning, partitioning, and optimization of Spark/Delta workloadsExposure to Azure AI Foundry or AI/ML integration into the lakehouse is a plusGovernance & QualityExperience implementing and designing data quality frameworks and testing standards across medallion tiersFamiliarity with Microsoft Purview or Unity Catalog for data catalog, lineage, and governanceExperience with master data management (MDM) integration patternsLeadership & Client-Facing SkillsExperience mentoring or providing technical guidance to junior engineersAbility to work directly with client stakeholders and architects to clarify requirements and design decisionsComfortable operating as the senior technical resource on client engagementsAbility to troubleshoot complex pipeline and performance issues independentlyNice to HaveMicrosoft Fabric, Azure Data Engineer, or Databricks certification (e.g., Databricks Certified Data Engineer Professional)Experience working across both Fabric and Databricks platformsExperience with CI/CD for data pipelines (Azure DevOps, GitHub Actions)Prior consulting experience across multiple client engagements
📌 Senior Data Engineer — Microsoft Fabric & Databricks (Madhya Pradesh)
🏢 XCentium
📍 Madhya Pradesh