Poor performance consuming multiple topics

2015-02-08 Thread Cj
he 10-100k range). Is it possible to set the fetch size to a lower number than the max message size and gracefully handle larger messages (as a trapped exception for example) in order to improve our throughput? Thank you in advance for your help CJ Woolard

Fetch size

2015-02-08 Thread CJ Woolard
he 10-100k range). Is it possible to set the fetch size to a lower number than the max message size and gracefully handle larger messages (as a trapped exception for example) in order to improve our throughput? Thank you in advance for your help CJ Woolard

Re: Poor performance consuming multiple topics

2015-02-09 Thread CJ Woolard
ll bind to all interfaces #host.name=kafka-1 # Hostname the broker will advertise to producers and consumers. If not set, it uses the # value for "host.name" if configured. Otherwise, it will use the value returned from # java.net.InetAddress.getCanonicalHostName(). adver

Re: Poor performance consuming multiple topics

2015-02-11 Thread CJ Woolard
u for all of your input, it's been very helpful for us. - CJ > On Feb 10, 2015, at 12:10 PM, "Guozhang Wang" wrote: > > CJ, > > On the consumer side there is another two configs named "fetch.min.bytes" > and "fetch.wait.max.ms": > > http