20 Nov
|
Important Group
|
Noida
20 Nov
Important Group
Noida
Must-Have Skills
-
Strong proficiency in SQL, Python, and PySpark.
-
Experience in Azure Data Factory (ADF) pipelines and Azure Synapse.
-
Expertise in Data Modeling and Data Warehousing (DWH) concepts.
-
Expertise in MS Fabric.
-
Knowledge of Delta Lake / Lakehouse Architecture.
-
Experience with version control (Azure DevOps / GIT).
-
Experience with Performance Tuning.
Job Responsibilities
-
Develop and maintain APIs, Azure Functions, and Python-based solutions.
-
Work with JSON inputs and process them using Python notebooks.
-
Design and implement data pipelines using Azure Data Factory and Synapse on Microsoft Azure.
-
Design and implement data pipelines on Microsoft Fabric.
-
Build and optimize SQL queries, Synapse packages, and related components.
-
Manage and configure Azure cloud workplace and its components.
-
Apply data warehousing solutions and patterns for scalable architecture.
-
Collaborate in Agile DevOps environments and implement CI/CD pipelines using GitHub and Azure DevOps.
-
Engage directly with business and technical stakeholders to gather requirements and deliver solutions.
-
Experience in using GitHub Copilot for Coding.
-
Monitor and troubleshoot pipeline failures, setup alerting and logging.
-
Ensure data quality and validation checks across pipelines.
-
Implement data security for PII.
-
Document technical designs, dataflows and pipeline architecture in Confluence.
-
Participate in code reviews and suggest coding best practices.
-
Optimize cost management of Azure resources.
-
Estimate efforts and provide timelines for assigned tasks.
Experience
-
7+ years of experience in data engineering and related technologies.
-
Proven ability to work independently and in cross-functional teams.
-
Certifications: Azure Data Engineer Associate.
-
Excellent soft skills to communicate clearly with stakeholders.
-
Ability to mentor team members.
Preferred Skills
-
Development of Azure Function Apps and APIs.
-
Familiarity with proc frameworks.
📌 Azure Data Engineer (Noida)
🏢 Important Group
📍 Noida