- 5+ years of robust handson experience in building end to end data pipeline using AWS tools like Lambda Glue S3 Athena Step Function
- Deep knowledge in python PySpark SQL and understanding of different sources like API databases SQL Snowflake Redshift etc
- Working with different formats like csv Json Parquet
- Good understanding of stream experience using Kafka Kinesis Apache Flink work closely during deployment of pipelines
- Work closely with PMs architects and QA in an agile and sprint model
- Strong communication and decisionmaking skills with cross functional teams and stakeholders