[
https://issues.apache.org/jira/browse/KAFKA-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon updated KAFKA-4191:
------------------------
Description:
Hi,
I am using kafka_2.11-0.10.0.1 and librdkafka-master on Windows 7,
and there are 3 brokers, 1 zookeeper, 1 producer (rdkafka_example.exe) and 1
consumer(rdkafka_consumer_example_cpp.exe), All of them are on the same PC.
But I found an issue that the producer failed to produce any data after the
leader of the brokers is down.
Here are the steps to reproduce this issue:
1. Start zookeeper.
2. Start the brokers by running the following commands:
kafka-server-start.bat .\config\server.properties
kafka-server-start.bat .\config\server-1.properties
kafka-server-start.bat .\config\server-2.properties
The configures for each server are:
config/server.properties:
broker.id=0
listeners=PLAINTEXT://:9092
log.dir=/tmp/kafka-logs-0
config/server-1.properties:
broker.id=1
listeners=PLAINTEXT://:9093
log.dir=/tmp/kafka-logs-1
config/server-2.properties:
broker.id=2
listeners=PLAINTEXT://:9094
log.dir=/tmp/kafka-logs-2
3. Create a new topic
kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor
3 --partitions 1 --topic topic1
Then you can see that the leader is broker 0 with following command
kafka-topics.bat --describe --zookeeper localhost:2181 --topic topic1
4. Start consumer:
rdkafka_consumer_example_cpp.exe -g 1 -b localhost:9092 topic1
5. Start producer:
rdkafka_example.exe -P -t topic1 -b localhost:9092
Now you can see that everything works fine.
6. Then stop broker0 by closing the command prompt which runs
'kafka-server-start.bat .\config\server.properties', and you can see that the
producer and consumer still work fine.
7. Then stop the producer and consumer by pressing Ctrl+C and then closing the
related command prompt, and start them again with the same step 4 and 5, now
you can see that both the producer and consumer do not work!
My expected behavior is that even the leader of multi-broker cluster is down,
we still can start the producer and consumer of librdkafka.
Would you please give me any help?
Thank you!
Leon
was:
Hi,
I am using kafka_2.11-0.10.0.1 and librdkafka-master on Windows 7,
and there are 3 brokers, 1 zookeeper, 1 producer (rdkafka_example.exe) and 1
consumer(rdkafka_consumer_example_cpp.exe), All of them are on the same PC.
But I found an issue that the producer failed to produce any data after the
leader of the brokers is down.
Here are the steps to reproduce this issue:
1. Start zookeeper.
2. Start the brokers by running the following commands:
kafka-server-start.bat .\config\server.properties
kafka-server-start.bat .\config\server-1.properties
kafka-server-start.bat .\config\server-2.properties
The configures for each server are:
config/server.properties:
broker.id=0
listeners=PLAINTEXT://:9092
log.dir=/tmp/kafka-logs-0
config/server-1.properties:
broker.id=1
listeners=PLAINTEXT://:9093
log.dir=/tmp/kafka-logs-1
config/server-2.properties:
broker.id=2
listeners=PLAINTEXT://:9094
log.dir=/tmp/kafka-logs-2
3. Create a new topic
kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor
3 --partitions 1 --topic topic1
Then you can see that the leader is broker 0 with following command
kafka-topics.bat --describe --zookeeper localhost:2181 --topic topic1
4. Start consumer:
rdkafka_consumer_example_cpp.exe -g 1 -b localhost:9092 topic1
5. Start producer:
rdkafka_example.exe -P -t topic1 -b localhost:9092
Now you can see that everything works fine.
6. Then stop broker0 by closing the command prompt which runs
'kafka-server-start.bat .\config\server.properties', and you can see that the
producer and consumer still work fine.
7. Then stop the producer and consumer by pressing Ctrl+C and then closing the
related command prompt, and start them again with the same step 4 and 5, now
you can see that both the producer and consumer do not work!
My expected behavior is that even the leader of multi-broker cluster is down,
we still can start the producer and consumer of librdkafka.
Would you please give me any help?
Thank you!
> After the leader broker is down, then start the producer of librdkafka, it
> cannot produce any data any more
> -----------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4191
> URL: https://issues.apache.org/jira/browse/KAFKA-4191
> Project: Kafka
> Issue Type: Improvement
> Components: clients
> Affects Versions: 0.10.0.1
> Environment: Windows 7
> Reporter: Leon
> Priority: Minor
>
> Hi,
> I am using kafka_2.11-0.10.0.1 and librdkafka-master on Windows 7,
> and there are 3 brokers, 1 zookeeper, 1 producer (rdkafka_example.exe) and 1
> consumer(rdkafka_consumer_example_cpp.exe), All of them are on the same PC.
> But I found an issue that the producer failed to produce any data after the
> leader of the brokers is down.
> Here are the steps to reproduce this issue:
> 1. Start zookeeper.
> 2. Start the brokers by running the following commands:
> kafka-server-start.bat .\config\server.properties
> kafka-server-start.bat .\config\server-1.properties
> kafka-server-start.bat .\config\server-2.properties
> The configures for each server are:
> config/server.properties:
> broker.id=0
> listeners=PLAINTEXT://:9092
> log.dir=/tmp/kafka-logs-0
> config/server-1.properties:
> broker.id=1
> listeners=PLAINTEXT://:9093
> log.dir=/tmp/kafka-logs-1
> config/server-2.properties:
> broker.id=2
> listeners=PLAINTEXT://:9094
> log.dir=/tmp/kafka-logs-2
> 3. Create a new topic
> kafka-topics.bat --create --zookeeper localhost:2181
> --replication-factor 3 --partitions 1 --topic topic1
> Then you can see that the leader is broker 0 with following command
> kafka-topics.bat --describe --zookeeper localhost:2181 --topic topic1
> 4. Start consumer:
> rdkafka_consumer_example_cpp.exe -g 1 -b localhost:9092 topic1
> 5. Start producer:
> rdkafka_example.exe -P -t topic1 -b localhost:9092
>
> Now you can see that everything works fine.
> 6. Then stop broker0 by closing the command prompt which runs
> 'kafka-server-start.bat .\config\server.properties', and you can see that the
> producer and consumer still work fine.
> 7. Then stop the producer and consumer by pressing Ctrl+C and then closing
> the related command prompt, and start them again with the same step 4 and 5,
> now you can see that both the producer and consumer do not work!
> My expected behavior is that even the leader of multi-broker cluster is down,
> we still can start the producer and consumer of librdkafka.
> Would you please give me any help?
> Thank you!
> Leon
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
