Role & responsibilities
- Design, develop, and maintain real-time data streaming pipelines using Amazon Kinesis Data Streams and Kinesis Data Firehose.
- Develop and manage data producers and consumers for Kinesis-based streaming applications.
- Implement real-time data processing using AWS Lambda, Kinesis Client Library (KCL), or Apache Flink.
- Build data ingestion pipelines from multiple sources into Amazon S3, Redshift, OpenSearch, and other AWS data platforms.
- Configure and optimize Kinesis streams, including shards, partition keys, throughput, scaling, retention, and consumer applications.
- Develop serverless data-processing solutions using AWS Lambda and Kinesis.
- Implement data transformation and delivery workflows using Kinesis Firehose and AWS Glue.
- Monitor streaming pipelines using Amazon CloudWatch and troubleshoot performance, latency, and data-processing issues.
- Implement appropriate IAM roles, policies, encryption, and security controls for AWS data pipelines.
- Develop reusable and scalable data-processing components using Python or Java.
- Optimize data pipelines for performance, reliability, scalability, and cost.
- Participate in design discussions, code reviews, testing, deployment, and production support.
- Collaborate with Data Engineers, Cloud Architects, Application Developers, and DevOps teams.
Preferred candidate profile
- 5+ years of experience in Data Engineering / Cloud Data Engineering
- Strong hands-on experience with Amazon Kinesis Data Streams
- Experience with Amazon Kinesis Data Firehose
- Strong knowledge of AWS Lambda
- Experience with Amazon S3
- Experience with AWS Glue
- Good knowledge of IAM and CloudWatch
- Programming experience in Python or Java
- Strong understanding of real-time data streaming and event-driven architecture
- Experience developing data ingestion and ETL/ELT pipelines
- Positive understanding of JSON, REST APIs, and data serialization formats
- Experience with SQL and relational databases
- Understanding of AWS networking and security concepts
If you are interested in this Above opporunity.Please provide following detail along with your updated profile to
[email protected]
Primary Skill -
Total Experience -
Relevant Experience into AWS Data Engineer Kinesis -
Principle Employer/Client Company -
Payroll company in case of Contract -
Current location
Work Location -
LWD in case of Notice period -
Incase of Long Notice period, is there any possibility to negotiate the days? If so, in how many days? -
Current CTC -
Expected CTC -
Any offer in pipeline (Provide Detail) -
Have PF Deductions and Form 16 -
I will be reaching out to you over a call or email as soon as possible.
Thanks & Regards,
Ravi Teja Kora
TAG
ZettaMine Labs Pvt Ltd.
📌 AWS Data Engineer Kinesis (Hyderabad)
🏢 Zettamine Labs
📍 Hyderabad