16 Nov
|
IntraEdge
|
Pune
Job Description
Senior Data Engineer
Experience:
6+ Years Role: Data Engineer Role Overview We are looking for an experienced Data Engineer with 6+ years of hands-on experience in building, developing, and maintaining scalable data pipelines and data processing solutions. The ideal candidate should have strong expertise in AWS, Python, and PySpark, along with a good understanding of data engineering principles and ETL/ELT processes. Experience with Snowflake and DBT will be an added advantage.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Build and optimise ETL/ELT workflows for large-scale data processing and integration.
• Leverage AWS services to develop, deploy, and manage cloud-based data engineering solutions.
• Perform data extraction, transformation, cleansing, and loading from multiple data sources.
• Develop efficient data processing solutions while ensuring data quality, accuracy, and reliability.
• Troubleshoot and optimise data pipelines for performance and scalability.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
• Follow best practices for data security, governance, and pipeline monitoring. Required Skills & Experience
• 6+ years of overall experience in Data Engineering.
• Strong hands-on experience with Python and PySpark.
• Good hands-on experience with AWS services for data engineering and data pipeline development.
• Strong understanding of ETL/ELT processes and data warehousing concepts.
• Experience in building, optimising, and maintaining large-scale data pipelines.
• Good understanding of SQL and data processing techniques.
• Experience working with structured and semi-structured data. Good to Have
• Experience with Snowflake for cloud data warehousing.
• Hands-on experience with DBT for data transformation and modelling.
• Exposure to modern data architecture and cloud-based data platforms. Preferred Candidate Profile
• Strong problem-solving and analytical skills.
• Ability to work independently and manage end-to-end data engineering activities.
• Positive communication and collaboration skills.
📌 Senior Data Engineer (Pune)
🏢 IntraEdge
📍 Pune