Role Descriptions: Design Development. Create and maintain data pipelines, producers, consumers, and stream processing applications using Kafka.
Responsibilities
- Integration: Connect Kafka with databases, APIs, microservices, and other enterprise systems.
- Performance Optimization: Tune Kafka clusters, topics, producers, and consumers for optimal performance, scalability, and reliability.
- Monitoring Troubleshooting: Monitor data flow, resolve issues, and ensure high availability.
- Architecture: Contribute to the design and strategy of data streaming architectures.
- Security Governance: Implement security, schema management (e.g. Schema Registry), and data governance policies.