17 Nov
|
IntraEdge
|
Pune
: Senior Data Engineer
Experience: 6+ Years
Role: Data Engineer
Role Overview
We are looking for an experienced Data Engineer with 6+ years of hands-on experience in building, developing, and maintaining scalable data pipelines and data processing solutions. The ideal candidate should have strong expertise in AWS, Python, and PySpark, along with a valuable understanding of data engineering principles and ETL/ELT processes.
Experience with Snowflake and DBT will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
- Build and optimise ETL/ELT workflows for large-scale data processing and integration.
- Leverage AWS services to develop, deploy, and manage cloud-based data engineering solutions.
- Perform data extraction, transformation, cleansing, and loading from multiple data sources.
- Develop efficient data processing solutions while ensuring data quality, accuracy, and reliability.
- Troubleshoot and optimise data pipelines for performance and scalability.
- Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
- Follow best practices for data security, governance, and pipeline monitoring.
Required Skills & Experience
- 6+ years of overall experience in Data Engineering.
- Strong hands-on experience with Python and PySpark.
- Good hands-on experience with AWS services for data engineering and data pipeline development.
- Strong understanding of ETL/ELT processes and data warehousing concepts.
- Experience in building, optimising, and maintaining large-scale data pipelines.
- Good understanding of SQL and data processing techniques.
- Experience working with structured and semi-structured data.
Good to Have
- Experience with Snowflake for cloud data warehousing.
- Hands-on experience with DBT for data transformation and modelling.
- Exposure to modern data architecture and cloud-based data platforms.
Preferred Candidate Profile
- Strong problem-solving and analytical skills.
- Ability to work independently and manage end-to-end data engineering activities.
- Good communication and collaboration skills.
📌 Senior Data Engineer (Pune)
🏢 IntraEdge
📍 Pune