We are looking for part time Freelancer for AWS Data Engineer Position.

Releavant Exp : 9+

Mandatory Tech Stack required:

Source: Salesforce (ECRM & OSC)

Backup: Grax

Cloud: AWS (EC2, S3, CloudWatch, DynamoDB, RDS, Secrets Manager, ALB, ASG)

Infrastructure as Code: Terraform

File Format: Parquet

Target: Enterprise Data Lake (EDL)

Schema: Blue Schema

Database: Blue Database

Query Language: SQL

JD
Build and maintain AWS data pipelines

Develop ETL/ELT pipelines using AWS Glue, PySpark, Python, and SQL.

Ingest data from sources like Salesforce, databases, APIs, and S3.

Load curated data into Amazon Redshift and data lake storage.
Optimize Athena and data lake performance

Convert JSON/CSV data into Parquet.

Use Snappy compression.

Design proper partitioning strategies.

Resolve split limit and performance issues.

Optimize Athena query costs.
Manage contemporary data lake architecture

Work with Apache Iceberg tables.

Perform migrations from traditional Parquet tables.

Support schema evolution, time travel, and ACID transactions.
Production support and troubleshooting

Investigate Glue jobs that suddenly become slow.

Debug Lambda timeouts.

Fix missing records and data quality issues.





Resolve Redshift performance problems.

Perform root cause analysis (RCA).
Infrastructure as Code

Build AWS infrastructure using Terraform.

Create reusable modules.

Manage Auto Scaling Groups, ALBs, IAM, Lambda, Secrets Manager, S3, Redshift, and DynamoDB.

Troubleshoot Terraform state and production deployment issues.
Security

Manage AWS Secrets Manager.

Configure Lambda-based secret rotation.

Ensure Terraform does not overwrite rotated passwords.

Implement IAM least-privilege access.
Backup and Disaster Recovery

Work with enterprise backup tools like Rubrik (their setting may use Grax for Salesforce).

Validate backup jobs.

Perform restores.

Support disaster recovery testing.

Verify restored data.
Data Quality

Validate source and target record counts.

Maintain audit/control tables (for example in DynamoDB).

Check checksums and duplicate records.

Troubleshoot data discrepancies reported by business users.
AWS Services

S3

Glue

Athena

Lambda

Redshift

DynamoDB

EventBridge

Step Functions

CloudWatch

Secrets Manager

IAM

Auto Scaling Groups

Application Load Balancer

📌 Aws Data Engineer & Etl Expert Hyderabad
🏢 ADV TECHMINDS
📍 Hyderabad