14 Nov
|
HMG America
|
India
Position: Azure Data Factory (ADF) Developer
Experience:
4–8 Years Relevant
Experience:
Hands-on experience in Azure Data Factory Employment Type: Full-Time
Location:
Remote Notice Period: Immediate to 30 Days Preferred Job Overview We are looking for an experienced Azure Data Factory (ADF) Developer with strong expertise in designing, developing, implementing, and maintaining data integration and ETL/ELT pipelines using Microsoft Azure. The ideal candidate should have hands-on experience in building scalable data pipelines, integrating multiple data sources, performing data transformations, and optimizing data workflows within the Azure cloud workplace.
Key Responsibilities
• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Create and manage pipelines, datasets, linked services, triggers, and integration runtimes.
• Implement data ingestion and transformation workflows from multiple sources.
• Integrate Azure Data Factory with Azure Blob Storage, Azure Data Lake Storage (ADLS), and Azure SQL Database.
• Work with SQL queries, stored procedures, and data transformation activities.
• Monitor pipeline execution, troubleshoot failures, and optimize performance.
• Implement incremental data loading and error-handling mechanisms.
• Ensure data quality,
consistency, and reliability across data pipelines.
• Collaborate with data engineers, developers, and business stakeholders. Required Technical Skills
• Strong hands-on experience with Microsoft Azure Data Factory (ADF).
• Good knowledge of ETL/ELT concepts and data integration.
• Experience with Azure Blob Storage and Azure Data Lake Storage.
• Strong SQL and database knowledge.
• Understanding of pipelines, datasets, linked services, triggers, and integration runtimes.
• Experience with data migration and transformation.
• Knowledge of REST APIs, JSON, and various data formats.
• Experience in debugging and performance optimization. Good to Have Skills
• Azure Databricks and PySpark.
• Python or PowerShell scripting.
• Azure Synapse Analytics.
• Azure DevOps and CI/CD pipelines.
• Git and version control.
• Experience with UiPath RPA or other automation technologies. Candidate Requirements
• Practical project experience in Azure Data Factory development.
• Strong analytical and problem-solving skills.
• Ability to independently develop and troubleshoot data pipelines.
• Good communication and collaboration skills.
📌 Azure Data Factory (India)
🏢 HMG America
📍 India