Job Summary

We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.

Key Responsibilities

- Develop and maintain data pipelines using Python and PySpark.
- Design and implement data lakehouse solutions on AWS.
- Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.
- Work with DynamoDB and other data storage technologies.
- Monitor data pipelines and ensure data quality, performance, and reliability.
- Collaborate with stakeholders and engineering teams to deliver data solutions.

Mandatory Skills

- 5+ years of overall professional experience.
- 3+ years of experience in data platforms and big data technologies.
- Strong proficiency in Python and PySpark.
- Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.
- Experience designing and implementing AWS data lakehouse architectures.

Valuable to Have

- Apache Spark and Apache Iceberg.
- AWS Lambda, EventBridge, Kinesis, and Redshift.
- Experience with real-time data pipelines and event-driven architectures.

Skills:- Amazon Web Services (AWS), Python and PySpark

📌 Data Engineer (Kochi)
🏢 ThomasMount Consulting
📍 Kochi