Data Engineer – AWS Data Platform

Job Summary

We are looking for a highly skilled and motivated data engineer with strong expertise in AWS data services to join our data platform team. The ideal candidate will have hands-on experience designing scalable data pipelines, workflow orchestration frameworks, and large-scale data migration solutions .

This role will be responsible for building robust cloud-native data engineering solutions on AWS , migrating datasets from legacy systems and data warehouses, and ensuring secure and efficient data processing pipelines across distributed environments.

Key Responsibilities

AWS Data Pipeline Development
Design and implement scalable ETL/ELT data pipelines using AWS Glue, AWS Lambda, and AWS S3 .
Build and maintain high-performance data ingestion frameworks for processing large-scale datasets.
Implement data pipelines for data warehousing and analytics platforms such as AWS Redshift .
Optimize storage and querying strategies using AWS S3 data lakes .

Data Workflow Orchestration




Develop and maintain data workflow orchestration frameworks using tools such as Apache Airflow or AWS Step Functions .
Automate complex workflows including data ingestion, transformation, validation, and loading processes .
Build reusable and configurable workflows to support multiple data processing use cases.

Data Migration & Integration
Lead data migrations from legacy data warehouse technologies to contemporary AWS data platforms.
Perform data migration from RDBMS systems (e.g., MySQL, SQL Server, Oracle) to AWS S3 or AWS Redshift .
Design scalable migration frameworks for large datasets with minimal downtime.
Integrate data sources from enterprise applications and external systems.

Data Security & Governance
Implement secure data pipelines using AWS security best practices .
Manage access control and data governance using AWS IAM and Lake Formation .
Ensure data encryption, access management, and compliance across all data platforms.

Performance

📌 Senior Data Engineer (Kanpur)
🏢 Trantor
📍 Kanpur