19 Nov
|
IntraEdge
|
Pune
Job Description
– Senior Data Engineer (Snowflake, Python & CP4D)
Experience:
7 Years Job Title: Senior Data Engineer Primary
Skills:
SQL, Python, Snowflake, Cloud (AWS/Azure/GCP), Data Warehousing, DBT, CP4D Good to Have: Apache Airflow Job Summary We are looking for an experienced Senior Data Engineer with 7 years of hands-on experience in SQL, Python, Snowflake, Cloud technologies, Data Warehousing, and IBM Cloud Pak for Data (CP4D). The ideal candidate should have strong expertise in developing scalable data pipelines, implementing ETL/ELT processes, and building efficient data warehouse solutions. Experience with AWS is preferred, along with exposure to DBT and Apache Airflow.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Develop and optimize data warehouse solutions using Snowflake.
• Work on ETL/ELT processes and data integration using IBM Cloud Pak for Data (CP4D).
• Build, manage, and optimize data ingestion and transformation workflows.
• Work with cloud platforms such as AWS, Azure, or GCP, with a preference for AWS.
• Develop and maintain data transformation models using DBT.
• Ensure data quality, consistency, reliability, and performance across data pipelines.
• Perform SQL query optimization and troubleshoot data processing issues.
• Collaborate with cross-functional teams to understand business requirements and deliver effective data engineering solutions.
• Follow best practices for data modeling, data governance, and pipeline development. Mandatory Skills
• 7 years of overall experience in Data Engineering or a related field.
• Strong hands-on experience in SQL and Python.
• Extensive hands-on experience with Snowflake.
• Experience with at least one cloud platform: AWS, Azure, or GCP (AWS preferred).
• Strong understanding of Data Warehousing concepts, data modeling, and ETL/ELT processes.
• Hands-on experience with DBT for data transformation.
• Mandatory hands-on experience with IBM Cloud Pak for Data (CP4D), particularly its ETL and data integration capabilities. Valuable to Have
• Experience with Apache Airflow for workflow orchestration and scheduling.
• Exposure to enterprise-scale data pipeline development.
• Understanding of data governance and data quality frameworks. Education Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
📌 Senior Data Engineer (Pune)
🏢 IntraEdge
📍 Pune