> numbers
> >> that seem pretty low to me...8000 events/sec on 2 brokers with 3CPU each
> >> and 5 partitions should be way faster than this and I don't know where
> to
> >> start to debug...
> >> the kafka-consumer-perf-test script gives me ridiculously
ons should be way faster than this and I don't know where to
>> start to debug...
>> the kafka-consumer-perf-test script gives me ridiculously low numbers
>> (1000 events/sec/thread)
>>
>> So what could be causing this?
>> From: jbringhu...@linkedin.com.INVALID
&g
?
> From: jbringhu...@linkedin.com.INVALID
> To: users@kafka.apache.org
> Subject: Re: Post on running Kafka at LinkedIn
> Date: Fri, 20 Mar 2015 22:16:29 +
>
> Keep in mind that these brokers aren't really stressed too much at any
> given time -- we need to stay ahead of the ca
script gives me ridiculously low numbers (1000
events/sec/thread)
So what could be causing this?
From: jbringhu...@linkedin.com.INVALID
To: users@kafka.apache.org
Subject: Re: Post on running Kafka at LinkedIn
Date: Fri, 20 Mar 2015 22:16:29 +
Keep in mind that these brokers aren't really stre
8400 message / broker / sec
> Do I get this right?
> Trying to benchmark my own test cluster and that's what I see with 2
> brokers...Just wondering if my numbers are good or bad...
>
>
>> Subject: Re: Post on running Kafka at LinkedIn
>> From: cl...@kafka.guru
800B messages / day = 9.26M messages / sec over 1100 brokers
= ~8400 message / broker / sec
Do I get this right?
Trying to benchmark my own test cluster and that's what I see with 2
brokers...Just wondering if my numbers are good or bad...
> Subject: Re: Post on running Kafka at
Yep! We are growing :)
-Clark
Sent from my iPhone
> On Mar 20, 2015, at 2:14 PM, James Cheng wrote:
>
> Amazing growth numbers.
>
> At the meetup on 1/27, Clark Haskins presented their Kafka usage at the time.
> It was:
>
> Bytes in: 120 TB
> Messages In: 585 million
> Bytes out: 540 TB
> T
Amazing growth numbers.
At the meetup on 1/27, Clark Haskins presented their Kafka usage at the time.
It was:
Bytes in: 120 TB
Messages In: 585 million
Bytes out: 540 TB
Total brokers: 704
In Todd's post, the current numbers:
Bytes in: 175 TB (45% growth)
Messages In: 800 billion (36% growth)
Oops. Thank you Tao Xiao!
-James
> On Mar 20, 2015, at 11:49 AM, tao xiao wrote:
>
> here is the slide
>
> http://www.slideshare.net/JonBringhurst/kafka-audit-kafka-meetup-january-27th-2015
>
> On Sat, Mar 21, 2015 at 2:36 AM, Xiao wrote:
>
>> Hi, James,
>>
>> Thank you for sharing it!
>>
here is the slide
http://www.slideshare.net/JonBringhurst/kafka-audit-kafka-meetup-january-27th-2015
On Sat, Mar 21, 2015 at 2:36 AM, Xiao wrote:
> Hi, James,
>
> Thank you for sharing it!
>
> The links of videos and slides are the same. Could you check the link of
> slides?
>
> Xiao Li
>
> On
Hi, James,
Thank you for sharing it!
The links of videos and slides are the same. Could you check the link of
slides?
Xiao Li
On Mar 20, 2015, at 11:30 AM, James Cheng wrote:
> For those who missed it:
>
> The Kafka Audit tool was also presented at the 1/27 Kafka meetup:
> http://www.mee
For those who missed it:
The Kafka Audit tool was also presented at the 1/27 Kafka meetup:
http://www.meetup.com/http-kafka-apache-org/events/219626780/
Recorded video is here, starting around the 40 minute mark:
http://www.ustream.tv/recorded/58109076
Slides are here:
http://www.ustream.tv/reco
For those who are interested in detail on how we've got Kafka set up at
LinkedIn, I have just published a new posted to our Engineering blog titled
"Running Kafka at Scale"
https://engineering.linkedin.com/kafka/running-kafka-scale
It's a general overview of our current Kafka install, tiered
13 matches
Mail list logo
