24 Sep
|
Trantor
|
Chandigarh
24 Sep
Trantor
Chandigarh
- 7+ years of Data Engineering experience with robust AWS cloud expertise and architecture understanding.
- Hands-on experience with AWS S3, Glue, Lambda, Athena, and Step Functions.
- Experience building APIs using API Gateway with Lambda/ECS/EKS.
- Strong experience in S3 bucket design, partitioning, lifecycle policies, IAM, and encryption.
- Hands-on Amazon Athena experience for data validation, ad-hoc queries, and performance optimization on large S3 datasets.
- Strong ETL/ELT pipeline development and optimization experience with AWS Glue and Step Functions.
- Experience with file-based ingestion, including SFTP, file drops, inbox/outbox, and event-driven S3 ingestion.
- Experience migrating data from RDBMS/data warehouses to AWS S3 or Redshift.
- Strong Python and SQL skills for data processing and automation.
- Experience designing data lake architectures using Raw, Curated, and Consumption layers.
- Strong understanding of partitioning, distributed processing, data quality, and pipeline optimization.
- Experience with event-driven pipelines using one or more of SQS, SNS, EventBridge, Kafka, or Kinesis.
- Strong debugging, monitoring, troubleshooting, and performance optimization skills.
📌 Sr. Data Engineer(AWS) (Chandigarh)
🏢 Trantor
📍 Chandigarh