24 Sep
|
Coforge
|
Greater Noida
24 Sep
Coforge
Greater Noida
Role & responsibilities :
We are seeking an experienced Kafka Engineer with strong expertise in designing, implementing, and supporting event-driven architectures using Apache Kafka. The ideal candidate will be responsible for building scalable, high-performance streaming data platforms, integrating enterprise applications, and ensuring reliability, availability, and performance of Kafka ecosystems.
Key Responsibilities
Kafka Platform Development
- Design, develop, and implement enterprise-grade streaming solutions using Apache Kafka.
- Build real-time data pipelines and event-driven integration architectures.
- Develop Kafka producers, consumers, and stream processing applications.
- Implement topic design, partitioning strategies, replication, and retention policies.
- Optimize Kafka clusters for performance, scalability, and fault tolerance.
Platform Administration & Support
- Install, configure, monitor, and maintain Kafka clusters.
- Perform capacity planning, performance tuning, and troubleshooting.
- Ensure high availability and disaster recovery readiness.
- Monitor cluster health using observability and monitoring tools.
- Resolve production incidents and provide L3 support.
Integration & Development
- Integrate Kafka with enterprise systems, APIs, databases, cloud platforms, and microservices.
- Develop real-time data ingestion and streaming solutions.
- Work closely with application teams to define event schemas and messaging standards.
- Implement Schema Registry and data governance standards.
DevOps & Automation
- Automate deployment and operational activities using CI/CD pipelines.
- Support containerized Kafka deployments on Kubernetes/OpenShift.
- Develop Infrastructure-as-Code (Terraform, Ansible, Helm) solutions.
- Implement security controls including authentication, authorization, and encryption.
Required Technical Skills
Kafka Expertise
- Solid hands-on experience with:
- Apache Kafka
- Kafka Connect
- Kafka Streams
- Confluent Platform
- Schema Registry
- KRaft / ZooKeeper
- MirrorMaker
Development Skills
- Java, Spring Boot
- Python
- REST APIs
- Microservices Architecture
Cloud & DevOps
- AWS, Azure, or GCP
- Docker
- Kubernetes/OpenShift
- Jenkins/GitHub Actions/Azure DevOps
Monitoring Tools
- Prometheus
- Grafana
- ELK Stack
- Splunk
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field.
- 5+ years of software engineering experience.
- 3+ years of hands-on experience with Apache Kafka.
- Experience working in Agile delivery environments.
Preferred Skills
- Confluent Kafka Certification.
- Event-Driven Architecture (EDA) expertise.
- Experience with large-scale distributed systems.
- Knowledge of Avro, Protobuf, and JSON schema management.
- Experience with airline, travel, retail, or financial services domains.
Key Deliverables
- Kafka architecture and solution design.
- Real-time event streaming platform implementation.
- High-availability Kafka cluster setup and management.
- Monitoring and performance optimization dashboards.
- Production support and operational runbooks.
Mandatory Skills- Kafka Desirable Skills- APACHE KAFKA,KAFKA AND STORM,Java,Spring Boot Docker
Exps - 5yrs to 10yrs
Notice Period - Immediate Joiner to 15 days location - Greater Noida
📌 Kafka Engineer (Greater Noida)
🏢 Coforge
📍 Greater Noida