Re: Producer performance in 0.9.0

2015-04-07 Thread Gian Merlino
Hey Chris, I tried setting producer.batch.size to 256KB (the Kafka docs say the default is 16KB) and the throughput is much better. That job is running a bit faster than 0.8 now. Gian On Tue, Apr 7, 2015 at 2:02 PM, Chris Riccomini wrote: > Hey Gian, > > Hmm, this is strange. We ran some tests,

Re: Producer performance in 0.9.0

2015-04-07 Thread Chris Riccomini
Hey Gian, Hmm, this is strange. We ran some tests, and found that the new producer to be faster than the old producer default (sync), and almost as fast as the old producer's async producer. Could you paste all of your configs? Cheers, Chris On Tue, Apr 7, 2015 at 10:40 AM, Gian Merlino wrote: