Job Description
Key Responsibilities
n
n
Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis , and related technologies.n
Build and support scalable data processing solutions on AWS .n
Modernize legacy ingestion frameworks using cloud-native services.n
Develop and optimize large-scale distributed data processing systems.n
Troubleshoot and support production data platforms and streaming applications.n
Collaborate with cross-functional teams on enterprise data integration initiatives.n

nRequired Skills & Experience
n
n
10+ years of experience in Data Engineering, Software Engineering, or related fields.n
Solid expertise in AWS Cloud Services and cloud-native architectures.n
Hands-on experience with Apache Spark (Scala & PySpark) .n
Robust knowledge of the Hadoop Ecosystem and distributed computing.n
Experience with Kafka , streaming technologies, and real-time data pipelines.n
Experience with AWS Kinesis, Kinesis Firehose, Flume , or similar ingestion platforms.n
Robust programming skills in Python, Scala, and Java .n
Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems .n

📌 Sr Data Engineer Hyderabad
🏢 Insight Global
📍 Hyderabad