19 Sep
|
Infosys
|
Hyderabad
Position: AWS Data Engineer
Experience: 2 to 5 years
Location: Hyderabad
Employment Type: Full time
Roles & Responsibilities
- Design, develop, and maintain scalable data pipelines using AWS services such as Glue, EMR, Lambda, S3, and Redshift.
- Build and manage ETL/ELT workflows to extract, transform, and load data from multiple sources.
- Develop batch and real-time data processing solutions using Spark, PySpark, Kafka, and Kinesis.
- Create and optimize data warehouse and data lake architectures.
- Perform data modeling and database design for analytics and reporting requirements.
- Ensure data quality, integrity, governance, and security across the data platform.
- Optimize SQL queries, Spark jobs, and AWS resources for performance and cost efficiency.
- Implement infrastructure as code (IaC)
using Terraform or CloudFormation.
- Automate deployment processes through CI/CD pipelines using Jenkins, GitHub Actions, or AWS DevOps tools.
- Monitor data pipelines and cloud resources using CloudWatch and other monitoring tools.
- Troubleshoot production issues and perform root cause analysis.
- Collaborate with Data Scientists, BI Developers, Analysts, and Business Stakeholders.
- Implement AWS IAM policies and security best practices.
- Manage large-scale structured and unstructured datasets in cloud environments.
- Support data migration projects from on-premises systems to AWS cloud.
📌 Aws Data Engineer (Hyderabad)
🏢 Infosys
📍 Hyderabad