12 Aug
|
Incedo
|
Hyderabad
AWS Data Engineer
Location: Hyderabad
Experience: 4–10 Years
Employment Type: Full-Time
About the Role
We are looking for an experienced AWS Data Engineer to design, build, and optimize scalable data pipelines and lakehouse architectures. The ideal candidate will have strong hands-on expertise in AWS cloud services, infrastructure automation, and modern data lake technologies.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines on AWS
Build and manage data lakehouse architectures using Apache Iceberg
Automate infrastructure provisioning using Terraform (IaC)
Work with large-scale structured and unstructured datasets across S3, Glue, EMR, Redshift, and related AWS services
Optimize data storage, partitioning, and query performance for lakehouse tables
Implement data quality checks, monitoring, and observability for pipelines
Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements
Ensure data security, governance, and compliance across environments
Participate in code reviews, CI/CD pipeline setup,
and deployment automation
Troubleshoot and resolve performance/data pipeline issues in production
Required Skills
4–10 years of experience in Data Engineering, with solid AWS cloud expertise
Hands-on experience with AWS services: S3, Glue, EMR, Lambda, Redshift, Athena, Kinesis (any combination)
Strong experience with Apache Iceberg and lakehouse architecture design
Proficiency in Terraform for infrastructure as code
Strong programming skills in Python and/or Scala
Solid understanding of SQL and data modeling (dimensional/star schema)
Experience with orchestration tools (Airflow, Step Functions, or similar)
Knowledge of data partitioning, compaction, and file formats (Parquet, Avro, ORC)
Familiarity with CI/CD pipelines and version control (Git)
Understanding of data governance, security, and IAM best practices on AWS Good to Have
Experience with Spark (PySpark/Spark SQL)
Exposure to Kafka or
📌 AWS Data Engineer (Hyderabad)
🏢 Incedo
📍 Hyderabad