06 Oct
|
Careernet
|
Bengaluru
06 Oct
Careernet
Bengaluru
Key Skills: Data Integration, Pyspark, Transformation, Azure ADF, Azure Databricks, SQL, Azure Data lake, Microsoft fabric, Git, Azure Cloud, Power BI, CICD
Roles and Responsibilities:
- Design and deliver end to end data solution across Microsoft Azure and Fabric platforms.
- Build and maintain scalable, high performance data pipelines using Azure Data Factory and Fabric.
- Engineer Microsoft Fabric Lakehouse architectures using medallion layers (Bronze, Silver, Gold).
- Design and implement data models and data products aligned to business needs.
- Develop and optimise data transformations using PySpark/ Spark within Microsoft Fabric Notebooks.
- Integrate data from on-premise, Microsoft Azure and SaaS platforms.
- Ensure data quality, performance, governance and reliability across all data products.
- Implement data operations practices including CI/CD, monitoring and version control.
Skills Required:
- 7+ years data engineering experience within the Microsoft platform.
- Strong experience with Azure Data Factory and contemporary data integration patterns through native connections, APIs, Python scripts etc.
- Strong proficiency in SQL and data modelling for analytics-ready solutions.
- Experience with Azure cloud data platforms and modern data architectures.
- Knowledge or experience of Microsoft Fabric, including lakehouse / warehouse concepts and Power BI integration.
- Experience with PySpark /Spark-based data processing (e.g. Databricks or Fabric).
- Understanding of DataOps principles, including CI/CD, automated testing, monitoring, and data lifecycle management.
- Experience designing medallion (Bronze/Silver/Gold) architectures, lakehouse patterns, and batch/near-real-time processing.
- Microsoft Fabric and Azure certifications are a plus.
Competencies:
- Strategic agility
- Openness to Learning
- Business acumen
- Communications skills
- Cultural awareness
- Ethics & Values
- Compassion
- Self-Development
- Priority Setting
- Drive for Results
Education: B.Tech, B.Tech-M.Tech Dual Degree, M.Tech, BCA, B.Sc., M.Sc., or MCA in any branch.
📌 Data Engineering Specialist (Bengaluru)
🏢 Careernet
📍 Bengaluru