05 Nov
|
MyCareernet
|
Bengaluru
05 Nov
MyCareernet
Bengaluru
Key
Skills:
Data Integration, Pyspark, Transformation, Azure ADF, Azure Databricks, SQL, Azure Data lake, Microsoft fabric, Git, Azure Cloud, Power BI, CICD Roles and
Responsibilities:
• Design and deliver end to end data solution across Microsoft Azure and Fabric platforms.
• Build and maintain scalable, high performance data pipelines using Azure Data Factory and Fabric.
• Engineer Microsoft Fabric Lakehouse architectures using medallion layers (Bronze, Silver, Gold).
• Design and implement data models and data products aligned to business needs.
• Develop and optimise data transformations using PySpark/ Spark within Microsoft Fabric Notebooks.
• Integrate data from on-premise, Microsoft Azure and SaaS platforms.
• Ensure data quality, performance, governance and reliability across all data products.
• Implement data operations practices including CI/CD, monitoring and version control. Skills Required:
• 7+ years data engineering experience within the Microsoft platform.
• Robust experience with Azure Data Factory and modern data integration patterns through native connections, APIs, Python scripts etc.
• Strong proficiency in SQL and data modelling for analytics-ready solutions.
•
•
• Experience with Azure cloud data platforms and modern data architectures.
• Knowledge or experience of Microsoft Fabric, including lakehouse / warehouse concepts and Power BI integration.
• Experience with PySpark /Spark-based data processing (e.g. Databricks or Fabric).
• Understanding of DataOps principles, including CI/CD, automated testing, monitoring, and data lifecycle management.
• Experience designing medallion (Bronze/Silver/Gold) architectures, lakehouse patterns, and batch/near-real-time processing.
• Microsoft Fabric and Azure certifications are a plus. Competencies:
• Strategic agility
• Openness to Learning
• Business acumen
• Communications skills
• Cultural awareness
• Ethics & Values
• Compassion
• Self-Development
• Priority Setting
• Drive for Results
Education:
B.
Tech, B.
Tech-M.
Tech Dual Degree, M.
Tech, BCA, B.
Sc., M.
Sc., or MCA in any branch.
📌 Data Engineering Specialist_104337 (Bengaluru)
🏢 MyCareernet
📍 Bengaluru