01 Sep
|
Insight Global
|
Hyderabad
01 Sep
Insight Global
Hyderabad
Job Description
Key Responsibilities
n
- n
- Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis, and related technologies.n
- Build and support scalable data processing solutions on AWS.n
- Modernize legacy ingestion frameworks using cloud-native services.n
- Develop and optimize large-scale distributed data processing systems.n
- Troubleshoot and support production data platforms and streaming applications.n
- Collaborate with cross-functional teams on enterprise data integration initiatives.n
nRequired Skills & Experience
n
- n
- 10+ years of experience in Data Engineering, Software Engineering, or related fields.n
- Strong expertise in AWS Cloud Services and cloud-native architectures.n
- Hands-on experience with Apache Spark (Scala & PySpark).n
- Robust knowledge of the Hadoop Ecosystem and distributed computing.n
- Experience with Kafka, streaming technologies, and real-time data pipelines.n
- Experience with AWS Kinesis, Kinesis Firehose, Flume, or similar ingestion platforms.n
- Strong programming skills in Python, Scala, and Java.n
- Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems.n
📌 Sr. Data Engineer (Hyderabad)
🏢 Insight Global
📍 Hyderabad