Thank you a lot for your help. Looking at Kafka logs the broker refused new connection because the limit was 10.
Davide On 29 May 2015 1:07 am, "Guozhang Wang" <wangg...@gmail.com> wrote: > From the logs it seems your producer (not consumer) cannot successfully > connect to the brokers. I would suggest you trying the console-producer > with some sample data and with the same bootstrap broker list and see if it > works. > > On Wed, May 27, 2015 at 10:43 AM, Yan Fang <yanfang...@gmail.com> wrote: > > > Hi Davide, > > > > This sometimes is due to Kafka broker. Are you able to send the message > to > > the brokers from the command line? > > > > Thanks, > > > > Fang, Yan > > yanfang...@gmail.com > > > > On Tue, May 26, 2015 at 5:49 AM, Davide Simoncelli < > netcelli....@gmail.com > > > > > wrote: > > > > > Hello, > > > > > > I’m testing my Samza application on a 3 nodes clusters. When the kafka > > > producer thread starts to read incoming messages, it keeps throwing the > > > following message on most of containers: > > > > > > 08:19:06.451 [kafka-producer-network-thread | > > > samza_producer-app-1-1432642687162-2] WARN > > > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip> > > > java.io.IOException: Connection reset by peer > > > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) > > > ~[na:1.8.0_45] > > > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) > > > ~[na:1.8.0_45] > > > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) > > > ~[na:1.8.0_45] > > > at sun.nio.ch.IOUtil.read(IOUtil.java:197) ~[na:1.8.0_45] > > > at > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) > > > ~[na:1.8.0_45] > > > at > > > > > > org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:60) > > > ~[kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.common.network.Selector.poll(Selector.java:248) > > > ~[kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) > > > [kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) > > > [kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) > > > [kafka-clients-0.8.2.0.jar:na] > > > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45] > > > 08:19:06.451 [kafka-producer-network-thread | > > > samza_producer-app-1-1432642687162-2] WARN > > > o.a.k.c.producer.internals.Sender - Got error produce response with > > > correlation id 539 on topic-partition system-1, retrying (2147483381 > > > attempts left). Error: NETWORK_EXCEPTION > > > 08:19:06.551 [kafka-producer-network-thread | > > > samza_producer-app-1-1432642687162-2] WARN > > > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip> > > > java.io.EOFException: null > > > at > > > > > > org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62) > > > ~[kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.common.network.Selector.poll(Selector.java:248) > > > ~[kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) > > > [kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) > > > [kafka-clients-0.8.2.0.jar:na] > > > at > > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) > > > [kafka-clients-0.8.2.0.jar:na] > > > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45] > > > > > > It isn’t a network issue because I tried to use the > > > kafka-console-consumer.sh script and it works just fine. Can you > provide > > me > > > more details about those errors please? > > > > > > Thanks > > > > > > Davide > > > > > > -- > -- Guozhang >
