How many brokers and partitions do you have? You may try increasing
batch.num.messages.
Thanks,
Jun
On Tue, May 13, 2014 at 5:56 PM, Zhujie (zhujie, Smartcare) <
first.zhu...@huawei.com> wrote:
> Dear all,
>
> We want to use kafka to collect and dispatch data file, but the
> performance is may
Dear all,
We want to use kafka to collect and dispatch data file, but the performance is
maybe lower than we want.
In our cluster,there is a provider and a broker. We use a one thread read file
from local disk of provider and send it to broker. The average throughput is
only 3 MB/S~4MB/S.
But
ujie, Smartcare)
> 发送时间: 2014年5月14日 8:56
> 收件人: 'us...@kafka.apache.org'; 'dev@kafka.apache.org'
> 主题: kafka performance question
>
> Dear all,
>
> We want to use kafka to collect and dispatch data file, but the
> performance is maybe lower than we want.
&g
our version is kafka_2.10-0.8.1
发件人: Zhujie (zhujie, Smartcare)
发送时间: 2014年5月14日 8:56
收件人: 'us...@kafka.apache.org'; 'dev@kafka.apache.org'
主题: kafka performance question
Dear all,
We want to use kafka to collect and dispatch data file, but the performance is
maybe lower t
