13 Nov
|
Tech Mahindra
|
Pune
13 Nov
Tech Mahindra
Pune
Job highlights
- 5–10 years experience in data engineering with expertise in Microsoft Fabric, Python/PySpark, SQL, ETL/ELT, and dimensional modelling
- Design, develop and maintain Microsoft Fabric data engineering solutions, build layered data architectures and production-grade ETL/ELT pipelines, integrate data from multiple sources, implement data quality and monitoring, collaborate with teams
Job Title: Fabric Data Engineer
Experience: 510 Years
About the Role
We are seeking a hands-on Fabric Data Engineer with strong expertise in Microsoft Fabric, Python and SQL to build and maintain scalable data solutions across analytics and reporting use cases.
Key Responsibilities
- Design, develop and maintain Microsoft Fabric Data Engineering solutions, including Lakehouse, Warehouse, Pipelines and Notebooks.
- Build and maintain layered data architectures (Medallion) and production-grade ETL/ELT pipelines for batch and incremental processing.
- Develop and optimize Python, PySpark and SQL solutions for data ingestion and transformation.
- Integrate data from databases, APIs, OData, files and SaaS applications.
- Implement data quality, validation, reconciliation, monitoring and error handling.
- Develop reusable, parameterized and configuration-driven data processes.
- Apply appropriate data modelling and data warehousing practices.
- Follow established development, naming, documentation, testing and deployment standards.
- Collaborate with data engineers,
analytics teams and business stakeholders.
Mandatory Skills
- 5–10 years of experience in data engineering, data warehousing, BI or related fields.
- Strong hands-on experience with Microsoft Fabric Data Engineering, including Lakehouse, Pipelines and Notebooks.
- Strong Python/PySpark and SQL skills.
- Solid understanding of ETL/ELT, data integration and data pipelines.
- Experience with incremental loading, CDC, watermarking and historical data processing.
- Experience with relational and analytical databases.
- Practical knowledge of dimensional modelling, star schemas and SCD Type 1/Type 2.
- Experience integrating data through APIs, OData, databases, files and SaaS applications.
- Experience with Git, CI/CD and DEV/TEST/PROD deployment processes.
- Experience with data quality, reconciliation, monitoring, logging and error handling.
- Understanding of SQL and Spark performance optimization.
Desirable Skills
- Exposure to SAP Analytics Cloud (SAC) and downstream reporting/data consumption use cases.
- Previous experience integrating or migrating SAP BTP calculated views to Microsoft Fabric or similar modern data platforms.
- Experience with Confluence for technical documentation and knowledge sharing.
- Exposure to Salesforce as a data source.
- Exposure to Microsoft Purview or other data governance, cataloguing, or metadata management solutions.
📌 Software Engineer (Pune)
🏢 Tech Mahindra
📍 Pune