Re: kafka performance question

2014-05-16 Thread Robert Turner
A couple of thoughts spring to mind, are you sending the whole file as 1 message? and is your producer code using sync or async mode? Cheers Rob. On 14 May 2014 15:49, Jun Rao wrote: > How many brokers and partitions do you have? You may try increasing > batch.num.messages. > > Thanks, > >

Re: kafka performance question

2014-05-15 Thread Jun Rao
How many brokers and partitions do you have? You may try increasing batch.num.messages. Thanks, Jun On Tue, May 13, 2014 at 5:56 PM, Zhujie (zhujie, Smartcare) < first.zhu...@huawei.com> wrote: > Dear all, > > We want to use kafka to collect and dispatch data file, but the > performance is may