Roles and Responsibilities
Design, develop, test, deploy, and maintain large-scale data pipelines using AWS services such as S3, Glue, Lambda, EMR, etc.
Collaborate with cross-functional teams to gather requirements and design solutions that meet business needs.
Develop complex SQL queries to extract insights from large datasets stored in Postgres databases.
Troubleshoot issues related to data processing workflows and resolve them efficiently.
Ensure high availability and scalability of the system by implementing monitoring tools like CloudWatch.