1. Design and implement scalable data solutions using AWS services (Lambda, Kinesis, S3, Glue, Redshift, RDS, SageMaker).
2. Develop and optimize ETL processes to reduce data processing time and storage costs.
3. Set up and manage Jenkins CI/CD pipelines for automated deployment of dbt models.
4. Write and maintain Python & SQL scripts for data integration and automation.
Job Requirements:
1. Proficiency in AWS services and cloud infrastructure management.
2. Robust programming and scripting skills (Python, SQL).
3. Experience with CI/CD tools, particularly Jenkins.
4. Proven track record in optimizing data pipelines and reducing operational costs.