- Apache Kafka Fundamentals: Deep understanding of Kafka architecture, including brokers, topics, partitions, producers, consumers, and ZooKeeper.
- Amazon MSK Management: Ability to provision, configure, and manage MSK clusters using the AWS console or CLI, including setting up VPCs, security groups, and encryption.
- Real-time Streaming: Expertise in designing high-throughput, low-latency, and fault-tolerant data pipelines. Kafka Connect & Streams: Knowledge of Kafka Connect for integrating with data sources (e.g., S3, Databases) and Kafka Streams API for processing real-time data.
- Kafka Fundamentals (Confluent Cloud)