Hi, All
I am running performance test on kafka, the command
bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance
test-rep-three 50000000000 100 -1 acks=1 bootstrap.servers=
10.100.10.101:9092 buffer.memory=67108864 batch.size=8196
Since we send 50 billions to brokers, it was OK but periodically pop out
such errors:
[2015-01-06 19:38:32,127] WARN Error in I/O with exemplary-birds.master/
127.0.1.1 (org.apache.kafka.common.network.Selector)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.kafka.common.network.Selector.poll(Selector.java:232)
at
org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:191)
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:184)
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115)
at java.lang.Thread.run(Thread.java:745)
1950 records sent, 224.4 records/sec (0.02 MB/sec), 611.4 ms avg latency,
9259.0 max latency.
2899650 records sent, 579930.0 records/sec (55.31 MB/sec), 2399.5 ms avg
latency, 9505.0 max latency.
3170219 records sent, 634043.8 records/sec (60.47 MB/sec), 568.7 ms avg
latency, 1201.0 max latency.
And I feel the error happen more often, our kafka cluster is a three node
cluster.
thanks
--
Alec Li
