We are looking for an AWS Data Engineer with experience in AWS Glue, Python, and ETL development.
Key Responsibilities:
- Design and develop ETL/data pipelines using AWS Glue and Python/PySpark.
- Extract, transform, and load data from sources such as Amazon S3, Redshift, and databases.
- Ensure data quality, validation, and integrity across data workflows.
- Monitor and optimize ETL jobs for better performance and cost efficiency.
- Work closely with Data Engineers, Analysts, and Business teams to understand requirements.
- Automate and orchestrate data workflows using AWS Glue Triggers, Workflows, and MWAA (Airflow).
- Prepare and maintain technical documentation.
Required Skills
- Solid experience in AWS Glue, Python, and PySpark
- Hands-on experience with Amazon S3, Redshift, and ETL processes
- Knowledge of data pipeline optimization and troubleshooting
- Experience with workflow orchestration tools (AWS Glue Workflows/MWAA)
- Good communication and problem-solving skills