Re: the impact of partition number

2014-12-31 Thread Jun Rao
All writes to a single partition are synchronized on the broker. So, the more partitions the more parallelism (and better throughput) you have. Thanks, Jun On Mon, Dec 22, 2014 at 1:24 PM, Sa Li wrote: > Hi, All > > I've run bin/kafka-producer-perf-test.sh on our kafka-production cluster, I >

the impact of partition number

2014-12-22 Thread Sa Li
Hi, All I've run bin/kafka-producer-perf-test.sh on our kafka-production cluster, I found the number of partitions really have huge impacts on the producer performance, see: start.time, end.time, compression, message.size, batch.size, total.data.sent.in.MB, MB.sec, total.data.sent.in.nMsg, nMsg.s