I am new to Apache Kafka. 

 

Issue : 

*       Single Node, meaning Zookeeper, Kafka and Producer and Consumer from
same AWS EC2 Windows 2019 instance working. 
*       When I move the Kafka Server to another EC2 instance the Producers
Messages are not showing up in the Consumer. In the current setup the
Zookeeper is installed on an AWS EC2 instance ( Windows 2019 ). Kafka Broker
is installed on another AWS EC2 Instance. The Kafka Broker is being
configured to know the Zookeeper locations 
*       The Topics are getting listed properly on the Kafka Broker Server

 

Configuration

*       zookeeper-3.8.0
*       kafka_2.12
*       All AWS Security Groups are being setup properly on Zookeeper
SERVER, via inbound and outbound rules. Hence I am able to telnet into Ports
2181 and 9092 from Kafka Broker Server
*       AWS Inbound Rules 



*       AWS Outbound Rules



Zookeeper Server 

 

Start zookeeper

zookeeper-server-start.bat kafka\config\zookeeper.properties

 

Kafka Broker

 

1.      \kafka\config\server.properties

broker.id=0

listeners=PLAINTEXT://:9092

advertised.listeners=PLAINTEXT://<broker IPv4 Address>:9092

zookeeper.connect=<zookeeperIP>:2181

 

2.      Start Kafka Server 

              kafka-server-start.bat  kafka\config\server.properties

3.      Start Producer

kafka-console-producer.bat --broker-list <Broker-IPV4 Address>:9092 --topic
multinodetopic

4.      Start Consumer 

kafka-console-consumer.bat --bootstrap-server <Broker-IPV4 Address>:9092
--topic multinodetopic

 

Review Attachments you will see no messages showing up in the consumer. 

 

I have been trying many things, since few weeks but con't get it working. 

 

Thanks

Rajaraman S 

 

 

 

Reply via email to