07 Nov
|
Perydot
|
Chennai
Job highlights
- Required Skills
- Strong hands-on experience with Azure Data Factory (ADF). . Good experience in designing and developing ETL / ELT data pipelines. . Hands-on experience with Snowflake and SQL. . Strong understanding of data warehousing concepts and data modelling. . .
Key Responsibilities
Azure Data Factory
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory.
- Create and manage ADF pipelines, datasets, linked services, triggers, and integration runtimes.
- Implement data ingestion and transformation workflows from multiple sources.
- Work with Copy Activity, Lookup, ForEach, If Condition, and other ADF activities.
- Configure and manage pipeline scheduling, monitoring, error handling, and performance optimization.
- Integrate Azure Data Factory with Azure Data Lake Storage (ADLS), Azure SQL Database, and other data sources.
- Implement incremental data loading and change data capture (CDC) mechanisms.
- Troubleshoot pipeline failures and ensure data quality and reliability.
Snowflake
- Develop and maintain data integration and loading processes in Snowflake.
- Work with Snowflake databases, schemas, tables, stages,
and warehouses.
- Write and optimize complex SQL queries for data transformation.
- Implement data loading using Snowflake stages and COPY INTO commands.
- Understand Snowflake architecture, performance tuning, and query optimization.
- Work with Snowflake integration with Azure Data Factory for data movement and processing.
Required Skills
- Strong hands-on experience with Azure Data Factory (ADF).
- Good experience in designing and developing ETL/ELT data pipelines.
- Hands-on experience with Snowflake and SQL.
- Strong understanding of data warehousing concepts and data modelling.
- Experience with Azure Data Lake Storage (ADLS Gen2).
- Good knowledge of incremental data loads and data transformation techniques.
- Solid debugging, troubleshooting, and problem-solving skills.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 ADF Snowflake Data Engineer (Chennai)
🏢 Perydot
📍 Chennai