Key Responsibilities /n /n
Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis, and related technologies.

/n
Build and support scalable data processing solutions on AWS.

/n
Modernize legacy ingestion frameworks using cloud-native services.

/n
Develop and optimize large-scale distributed data processing systems.

/n
Troubleshoot and support production data platforms and streaming applications.

/n
Collaborate with cross-functional teams on enterprise data integration initiatives.

/n /n Required Skills & Experience /n /n
10+ years of experience in Data Engineering, Software Engineering, or related fields.

/n
Solid expertise in AWS Cloud Services and cloud-native architectures.

/n
Hands-on experience with Apache Spark (Scala & PySpark).

/n
Robust knowledge of the Hadoop Ecosystem and distributed computing.

/n
Experience with Kafka, streaming technologies, and real-time data pipelines.

/n
Experience with AWS Kinesis, Kinesis Firehose, Flume, or similar ingestion platforms.

/n
Solid programming skills in Python, Scala, and Java.

/n
Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems.

/n

📌 Sr Data Engineer Hyderabad (India)
🏢 Insight Global
📍 India