Role & responsibilities
Location: Noida
Experience: 5-10 Years.
Job Summary
We are looking for an experienced AWS Data Engineer to design, develop, and support large-scale data migration solutions. The ideal candidate should have robust expertise in AWS Glue, PySpark, Python, and AWS Lambda with experience in ETL development, data migration, monitoring, and cloud-based deployments.
Key Responsibilities
- Develop and implement data migration workflows based on approved metadata extraction and business requirements.
- Design and support full-load and incremental/partial-load migration processes.
- Build restart, recovery, and re-run mechanisms for failed migration jobs.
- Develop ETL pipelines using AWS Glue and PySpark.
- Create Python-based data transformation and validation processes.
- Implement logging, monitoring, reconciliation, and audit mechanisms.
- Develop serverless components using AWS Lambda.
- Deploy, execute, and support solutions in AWS environments.
- Perform data validation, reconciliation, and migration testing.
- Collaborate with business, application, and infrastructure teams during migration activities.
📌 Data Engineer-II (Noida)
🏢 Coforge
📍 Noida