20 Nov
|
IntraEdge
|
Pune
– Senior Data Engineer (Snowflake, Python & CP4D)
Experience: 7 Years
Job Title: Senior Data Engineer
Primary Skills: SQL, Python, Snowflake, Cloud (AWS/Azure/GCP), Data Warehousing, DBT, CP4D
Positive to Have: Apache Airflow
Job Summary
We are looking for an experienced Senior Data Engineer with 7 years of hands-on experience in SQL, Python, Snowflake, Cloud technologies, Data Warehousing, and IBM Cloud Pak for Data (CP4D). The ideal candidate should have robust expertise in developing scalable data pipelines, implementing ETL/ELT processes, and building effective data warehouse solutions. Experience with AWS is preferred, along with exposure to DBT and Apache Airflow.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Python and SQL.
Develop and optimize data warehouse solutions using Snowflake.
Work on ETL/ELT processes and data integration using IBM Cloud Pak for Data (CP4D).
Build, manage, and optimize data ingestion and transformation workflows.
Work with cloud platforms such as AWS, Azure, or GCP, with a preference for AWS.
Develop and maintain data transformation models using DBT.
Ensure data quality, consistency, reliability, and performance across data pipelines.
Perform SQL query optimization and troubleshoot data processing issues.
Collaborate with cross-functional teams to understand business requirements and deliver effective data engineering solutions.
Follow best practices for data modeling, data governance, and pipeline development.
Mandatory Skills
7 years of overall experience in Data Engineering or a related field.
Strong hands-on experience in SQL and Python.
Extensive hands-on experience with Snowflake.
Experience with at least one cloud platform: AWS, Azure, or GCP (AWS preferred).
Strong understanding of Data Warehousing concepts, data modeling, and ETL/ELT processes.
Hands-on experience with DBT for data transformation.
Mandatory hands-on experience with IBM Cloud Pak for Data (CP4D), particularly its ETL and data integration capabilities.
Good to Have
Experience with Apache Airflow for workflow orchestration and scheduling.
Exposure to enterprise-scale data pipeline development.
Understanding of data governance and data quality frameworks.
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
📌 Senior Data Engineer Pune
🏢 IntraEdge
📍 Pune