- Design and develop scalable batch and streaming data pipelines on AWS.
- Build transformation and processing workflows using Python and PySpark.
- Develop and manage data processing jobs using AWS Glue and Amazon EMR.
- Orchestrate dependent data workflows and production schedules using AWS Step Functions.
- Implement data integrations and cloud-based services with attention to reliability, security, and operational efficiency. Skills Required:
- 4
- 10 years of relevant experience in data engineering or big data platform development.
- Solid hands-on experience designing and implementing data engineering solutions on AWS.
- Proficiency in Python and PySpark for large-scale data processing.
- Experience developing and operating data pipelines using AWS Glue and Amazon EMR.
- Understanding of distributed data processing, cloud architecture, and production data workflows. Good to Have:
- Experience with Amazon ECS and Amazon DynamoDB.
Education:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
📌 Aws Data Engineer (Thiruvananthapuram)
🏢 Careernet
📍 Thiruvananthapuram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.