16 Sep
|
BPMLinks
|
Hyderabad
16 Sep
BPMLinks
Hyderabad
Job DescriptionJob Title: Sr. AWS MSK Specialist (Kafka Admin)
nJob Summary:
nWe're looking for a skilled Kafka Admin with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design, build, and maintain high-performance data pipelines. You'll work closely with data architects and software engineers to ensure seamless data integration and streaming capabilities using AWS MSK.
nResponsibilities:
n
- n
- Design, develop, and manage real-time data pipelines using AWS MSKn
- Integrate AWS MSK with various data sources and consumersn
- Monitor and optimize AWS MSK cluster performance and costsn
- Collaborate with DevOps to ensure optimal performance and uptimen
- Implement security best practices for data streaming and storagen
- Document technical processes and best practicesn
- Work with AWS services like S3, Glue, and Lambda for data processing and integrationn
nRequirements:
n
- n
- Bachelor's degree in computer science,
Engineering, or a related fieldn
- 4-5 years of experience working with AWS MSK or Apache Kafka in a production environmentn
- Robust understanding of distributed systems, real-time data processing, and cloud-based data streamingn
- Proficiency in programming languages such as Pythonn
- Experience with AWS services like S3, Glue, and Lambdan
- Excellent problem-solving and debugging skillsn
nNice-to-Have Skills:
n
- n
- Experience with containerization technologies like Docker and Kubernetesn
- Familiarity with other messaging systems like RabbitMQ or Apache Pulsarn
- Experience with data serialization formats like Avro, Protobuf, or JSONn
- Knowledge of Snowflake or other cloud-based data warehousing solutionsn
📌 Kafka Admin (Hyderabad)
🏢 BPMLinks
📍 Hyderabad