Hello,
I’m testing my Samza application on a 3 nodes clusters. When the kafka producer
thread starts to read incoming messages, it keeps throwing the following
message on most of containers:
08:19:06.451 [kafka-producer-network-thread |
samza_producer-app-1-1432642687162-2] WARN o.a.kafka.common.network.Selector -
Error in I/O with <host>/<ip>
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[na:1.8.0_45]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
~[na:1.8.0_45]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
~[na:1.8.0_45]
at sun.nio.ch.IOUtil.read(IOUtil.java:197) ~[na:1.8.0_45]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
~[na:1.8.0_45]
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:60)
~[kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.0.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.0.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.0.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
08:19:06.451 [kafka-producer-network-thread |
samza_producer-app-1-1432642687162-2] WARN o.a.k.c.producer.internals.Sender -
Got error produce response with correlation id 539 on topic-partition system-1,
retrying (2147483381 attempts left). Error: NETWORK_EXCEPTION
08:19:06.551 [kafka-producer-network-thread |
samza_producer-app-1-1432642687162-2] WARN o.a.kafka.common.network.Selector -
Error in I/O with <host>/<ip>
java.io.EOFException: null
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
~[kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.0.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.0.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.0.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.0.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
It isn’t a network issue because I tried to use the kafka-console-consumer.sh
script and it works just fine. Can you provide me more details about those
errors please?
Thanks
Davide
