Hi,
I am using kafka_2.9.2-0.8.1.1
Intended to run performance test using run-simulator.sh file.
I started zookeeper and kafka server and finally run the below command
/run-simulator.sh -kafkaServer=localhost -numTopic=10
-reportFile=report-html/data -time=15 -numConsumer=20 -numProducer=40
-xa
gt; From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Monday, February 3, 2014 9:11 PM
> To: users@kafka.apache.org
> Subject: Re: Kafka performance test: "--request-num-acks -1" kills
> throughput
>
> Michael,
>
> Your understanding is mostly correct. For 2, the fol
users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-num-acks -1" kills throughput
Michael,
Your understanding is mostly correct. For 2, the follower will issue another
fetch request as soon as it finishes processing the response of the previous
fetch (by adding data, if any,
d of requests from follower brokers and timeout
> settings will impact the throughput of a synchronized producer when
> acksNum=-1?
>
> Thank you,
> Michael Popov
>
> -Original Message-
> From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Monday, February 3, 2014 10:09
Sent: Monday, February 3, 2014 10:09 AM
To: users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-num-acks -1" kills throughput
What's replica.fetch.min.bytes? Is it the default value of 1? If not, could you
try to set it to 1? If yes, could you try using a small
gt; numbers are not as high as in other people's tests, that's understandable.
> The main concern is why throughput drops 4-10 times when a number of
> expected acks is not 1.
>
> Should we wait for newer versions of Kafka and settle with acks=1 for now?
>
> Thank you
fka and settle with acks=1 for now?
Thank you,
Michael Popov
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Friday, January 31, 2014 8:57 PM
To: users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-num-acks -1" kills throughput
The request log
of the throughput in
> tests with acksNum!=1.
>
> What may cause such long responses? Is there a way to address this issue?
>
> Thank you,
> Michael Popov
>
>
>
> -Original Message-
> From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Friday, January 31, 2014 7:52 AM
> To:
.
What may cause such long responses? Is there a way to address this issue?
Thank you,
Michael Popov
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Friday, January 31, 2014 7:52 AM
To: users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-
d4111,0]
> (kafka.producer.async.DefaultEventHandler)
> java.net.SocketTimeoutException
> [2014-01-30 18:33:39,740] WARN Failed to send producer request with
> correlation id 81147 to broker 1 with data for partitions [d4111,0]
> (kafka.producer.async.DefaultEventHandler)
> java.net.SocketTimeoutE
nuary 29, 2014 5:15 PM
To: users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-num-acks -1" kills throughput
Michael,
The producer client in 0.8 has a single thread that does blocking data sends
one broker at a time. However, we are working on a rewrite of the produce
.DefaultEventHandler)
java.net.SocketTimeoutException
Thank you,
Michael Popov
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Wednesday, January 29, 2014 9:01 PM
To: users@kafka.apache.org
Subject: Re: Kafka performance test: "--request-num-acks -1" kills throughput
Does
Does the result change with just 1 partition?
Thanks,
Jun
On Wed, Jan 29, 2014 at 4:06 PM, Michael Popov wrote:
> Hi,
>
> We need a reliable low-latency message queue that can scale. Kafka looks
> like a right system for this role.
>
> I am running performance tests on multiple platforms: Lin
Michael,
The producer client in 0.8 has a single thread that does blocking data
sends one broker at a time. However, we are working on a rewrite of the
producer with an improved design that can support higher throughput
compared to the current one. We don't have any performance numbers to share
ye
Hi,
We need a reliable low-latency message queue that can scale. Kafka looks like a
right system for this role.
I am running performance tests on multiple platforms: Linux and Windows. For
test purposes I create topics with 2 replicas and multiple partitions. In all
deployments running test pr
The results there are obtained using our ProducerPerformance tool.
Thanks,
Jun
On Wed, Jan 15, 2014 at 1:14 AM, 陈小军 wrote:
> I was just reading this:
> https://cwiki.apache.org/confluence/display/KAFKA/Performance+testingHasthis
> been implemented yet? I can't seem tofind it in the source.
I was just reading
this:https://cwiki.apache.org/confluence/display/KAFKA/Performance+testingHas
this been implemented yet? I can't seem tofind it in the source.
Best Regards
Jerry
17 matches
Mail list logo
