About the Role
We are looking for a highly skilled AWS Data Engineer to design, build, and optimize scalable data solutions on AWS cloud. The ideal candidate should have strong expertise in data engineering, ETL/ELT development, cloud-native architectures, and modern data warehousing technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS.
- Build and optimize ETL/ELT processes for structured and unstructured data.
- Develop data ingestion frameworks from multiple source systems.
- Implement and manage cloud-based data lakes and data warehouses.
- Ensure data quality, governance, security, and compliance standards.
- Optimize data processing performance and cost efficiency within AWS.
- Collaborate with Data Analysts, Data Scientists, and Business stakeholders to deliver data solutions.
- Troubleshoot production issues and provide timely resolutions.
- Implement CI/CD practices for data engineering workflows.
- Create technical documentation and best practices for data architecture.
Required Skills
AWS Services
- AWS Glue
- Amazon S3
- Amazon Redshift
- AWS Lambda
- AWS EMR
- AWS Athena
- AWS Step Functions
- AWS CloudWatch
- AWS IAM
Data Engineering
- Solid SQL and Python programming
- Data Modeling (Star Schema, Snowflake Schema)
- ETL/ELT Pipeline Development
- Data Warehousing Concepts
- Data Lake Architecture
Big Data Technologies
- Apache Spark (PySpark)
- Hadoop Ecosystem (Good to Have)
- Kafka/Kinesis (Preferred)
DevOps & Automation
- Git/GitHub/GitLab
- CI/CD Pipelines
- Terraform or CloudFormation
- Docker (Preferred)
Preferred Qualifications
- Experience with Snowflake, Databricks, or Microsoft Fabric is a plus.
- Knowledge of Data Governance and Data Quality frameworks.
- Experience working in Agile/Scrum environments.
- AWS Certification (AWS Certified Data Engineer, Solutions Architect, or Developer Associate) preferred.
📌 Data Engineer (Hyderabad)
🏢 EXL
📍 Hyderabad