Re: Kafka consumer performance with large network delay

2016-07-23 Thread Ewen Cheslack-Postava
Kafka will batch messages, but if the rate of delivery is too slow it'll fall back to delivering only one message per batch. What is the total throughput per broker? -Ewen On Fri, Jul 15, 2016 at 5:21 PM, Boris Sorochkin wrote: > Hi All, > I have Kafka setup with default settings and relatively

Kafka consumer performance with large network delay

2016-07-15 Thread Boris Sorochkin
Hi All, I have Kafka setup with default settings and relatively large network delay (up to dozens milliseconds) between a broker and consumer. This setup has very poor performance (~30kbps per client) despite of no packet loss on the way (the network is very reliable). After investigation of the tr