- Hands-on experience in Glue, Pyspark
- Experience on EMR, S3, IAM, Lambda, Cloud formation, Python
- AMI Rehydration, Python, ELB and other AWS components knowledge
- AWS monitoring setup and building the traffic dashboard and SNOW incidents for AWS related traffic and services
- CI/CD build and deployment support
- Ensure reliability of data pipelines, ETL processes, data transformations
- Identify areas of improvement in data quality processes, propose solutions to enhance data reliability, accuracy
- Implement data quality best practices, optimize data workflows