We are looking for an experienced Azure Data Engineer with 5 years of hands-on experience in designing developing and supporting modern data engineering solutions. The ideal candidate should have strong expertise in Azure Apache Airflow Snowflake Informatica SQL and Python .
The candidate will be responsible for building and maintaining scalable data pipelines implementing ETL/ELT processes integrating data from multiple sources and ensuring data quality and reliability.
Key Responsibilities
- Design develop and maintain scalable data pipelines using Azure and other data engineering technologies.
- Develop and manage ETL/ELT workflows using Informatica and Airflow.
- Work extensively with Snowflake for data warehousing data transformation and analytical workloads.
- Develop and optimize complex SQL queries stored procedures and data transformations .
- Use Python for data processing automation scripting and pipeline development.
- Build and schedule workflows using Apache Airflow including DAG creation and monitoring.
- Integrate data from various sources into Azure/Snowflake environments.
- Perform data validation reconciliation troubleshooting and performance tuning.
- Monitor production data pipelines and resolve failures and data-quality issues.
- Collaborate with data architects developers analysts and business stakeholders.
- Follow best practices for data security governance scalability and performance.
Required Skills
- 5 years of experience in Data Engineering.
- Strong hands-on experience with Microsoft Azure data services.
- Hands-on experience with Apache Airflow and DAG development.
- Strong experience with Snowflake .
- Hands-on experience with Informatica / Informatica ETL .
- Strong proficiency in SQL .
- Hands-on experience with Python .
- Robust understanding of ETL/ELT concepts and data warehousing .
- Experience in developing scheduling monitoring and troubleshooting data pipelines.
- Good understanding of data integration and transformation processes.