16 Nov
|
Topcoder
|
Noida
Must-Have Skills
- Strong proficiency in SQL, Python, and PySpark.
- Experience in Azure Data Factory (ADF) pipelines and Azure Synapse.
- Expertise in Data Modeling and Data Warehousing (DWH) concepts.
- Expertise in MS Fabric.
- Knowledge of Delta Lake / Lakehouse Architecture.
- Experience with version control (Azure DevOps / GIT).
- Experience with Performance Tuning.
Job Responsibilities
- Develop and maintain APIs, Azure Functions, and Python-based solutions.
- Work with JSON inputs and process them using Python notebooks.
- Design and implement data pipelines using Azure Data Factory and Synapse on Microsoft Azure.
- Design and implement data pipelines on Microsoft Fabric.
- Build and optimize SQL queries, Synapse packages, and related components.
- Manage and configure Azure cloud workplace and its components.
- Apply data warehousing solutions and patterns for scalable architecture.
- Collaborate in Agile DevOps environments and implement CI/CD pipelines using GitHub and Azure DevOps.
- Engage directly with business and technical stakeholders to gather requirements and deliver solutions.
- Experience in using GitHub Copilot for Coding.
- Monitor and troubleshoot pipeline failures, setup alerting and logging.
- Ensure data quality and validation checks across pipelines.
- Implement data security for PII.
- Document technical designs, dataflows and pipeline architecture in Confluence.
- Participate in code reviews and suggest coding best practices.
- Optimize cost management of Azure resources.
- Estimate efforts and provide timelines for assigned tasks.
Experience
- 7+ years of experience in data engineering and related technologies.
- Proven ability to work independently and in cross-functional teams.
- Certifications: Azure Data Engineer Associate.
- Excellent soft skills to communicate clearly with stakeholders.
- Ability to mentor team members.
Preferred Skills
- Development of Azure Function Apps and APIs.
- Familiarity with proc frameworks.
📌 Azure Data Engineer (Noida)
🏢 Topcoder
📍 Noida