19 Nov
|
IntraEdge
|
Pune
– Senior Data Engineer (Snowflake, Python & CP4D)
Experience: 7 Years
Job Title: Senior Data Engineer
Primary Skills: SQL, Python, Snowflake, Cloud (AWS/Azure/GCP), Data Warehousing, DBT, CP4D
Good to Have: Apache Airflow
Job Summary
We are looking for an experienced Senior Data Engineer with 7 years of hands-on experience in SQL, Python, Snowflake, Cloud technologies, Data Warehousing, and IBM Cloud Pak for Data (CP4D). The ideal candidate should have robust expertise in developing scalable data pipelines, implementing ETL/ELT processes, and building efficient data warehouse solutions. Experience with AWS is preferred, along with exposure to DBT and Apache Airflow.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and SQL.
- Develop and optimize data warehouse solutions using Snowflake.
- Work on ETL/ELT processes and data integration using IBM Cloud Pak for Data (CP4D).
- Build, manage, and optimize data ingestion and transformation workflows.
- Work with cloud platforms such as AWS, Azure, or GCP, with a preference for AWS.
- Develop and maintain data transformation models using DBT.
- Ensure data quality, consistency, reliability, and performance across data pipelines.
- Perform SQL query optimization and troubleshoot data processing issues.
- Collaborate with cross-functional teams to understand business requirements and deliver effective data engineering solutions.
- Follow best practices for data modeling, data governance, and pipeline development.
Mandatory Skills
- 7 years of overall experience in Data Engineering or a related field.
- Strong hands-on experience in SQL and Python.
- Extensive hands-on experience with Snowflake.
- Experience with at least one cloud platform: AWS, Azure, or GCP (AWS preferred).
- Strong understanding of Data Warehousing concepts, data modeling, and ETL/ELT processes.
- Hands-on experience with DBT for data transformation.
- Mandatory hands-on experience with IBM Cloud Pak for Data (CP4D), particularly its ETL and data integration capabilities.
Good to Have
- Experience with Apache Airflow for workflow orchestration and scheduling.
- Exposure to enterprise-scale data pipeline development.
- Understanding of data governance and data quality frameworks.
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
📌 Senior Data Engineer (Pune)
🏢 IntraEdge
📍 Pune