Re: question about async publisher blocking when broker is down.

2015-11-08 Thread Damian Guy
Hi, If you are using the Scala Producer then yes it will drop messages. It will try up to num retries times and then throw a FailedToSendMessageException. This is caught in the ProducerSendThread and logged, you'd see something like: "Error in handling batch of 10 events ..." If you don't want to

Re: question about async publisher blocking when broker is down.

2015-11-08 Thread Li Tao
Hi, according to my undersanding, your scenario does not apply here. Async does not mean it buffers message when connection is lost(you killed the broker). If the connection is down, the producer should detect it as a exceptional condition, and throw this exception to application level to handle it

question about async publisher blocking when broker is down.

2015-10-30 Thread Ilya Goberman
I am new to kafka and apologize if this is already answered. I am testing a simple async publisher behavior when broker is down. I use kafka version 8.2.2. I have set up "queue.buffering.max.messages" to 200 and "queue.enqueue.timeout.ms" set to -1. My understanding is that if "queue.enqueue.t