I have a simple multi-threaded app trying to send numerous fixed-length, 2048
byte or 3072 byte messages into an Apache Kafka 0.7.2 cluster (3 machines)
running in AWS on some AWS AMIs. When the messaging volume increases rapidly, a
spike, I start running into lots of problems, specifically
Inv
to the broker are corrupted. Typically,
>this is because either the producer sends the corrupted data somehow or
>the
>network is flaky. Are you using a java producer? Is this reproducible?
>
>Thanks,
>
>Jun
>
>
>On Fri, May 17, 2013 at 7:08 AM, Jason Weiss
>wrote:
&g
re you using a java producer? Is this reproducible?
>
>Thanks,
>
>Jun
>
>
>On Fri, May 17, 2013 at 7:08 AM, Jason Weiss
>wrote:
>
>> I have a simple multi-threaded app trying to send numerous fixed-length,
>> 2048 byte or 3072 byte messages into an Apache Kafka
I'm trying to maximize my throughput and seem to have hit a ceiling. Everything
described below is running in AWS.
I have configured a Kafka cluster with 5 machines, M1.Large, with 600
provisioned IOPS storage for each EC2 instance. I have a Zookeeper server (we
aren't in production yet, so I d
e your results. Is this 0.8? What replication factor are
>you using?
>
>
>On Mon, May 20, 2013 at 8:11 AM, Jason Weiss
>wrote:
>
>> I'm trying to maximize my throughput and seem to have hit a ceiling.
>> Everything described below is running in AWS.
>>
>&
I've made some good progress on tuning Kafka for our needs, reaching about
40,000 events per second in our environment. One thing that I noticed in all of
the Kafka server logs is an inordinate amount (I think?) of Closing socket
connection INFO statements.
I realize they are INFO, so I assume
ao" wrote:
>In 0.7, each producer reconnects to the broker periodically. Take a look
>at
>reconnect.interval in http://kafka.apache.org/07/configuration.html
>
>Thanks,
>
>Jun
>
>
>On Tue, May 21, 2013 at 7:35 AM, Jason Weiss
>wrote:
>
>> I've
the CPU busy? Is IO maxed out? Network? Disk? Use a tool like atop,
>and tell us what you find.
>
>Philip
>
>On May 20, 2013, at 6:43 PM, Ken Krugler
>wrote:
>
>> Hi Jason,
>>
>> On May 20, 2013, at 10:01am, Jason Weiss wrote:
>>
>>> Hi Sco
All,
I asked a number of questions of the group over the last week, and I'm happy to
report that I've had great success getting Kafka up and running in AWS. I am
using 3 EC2 instances, each of which is a M2 High-Memory Quadruple Extra Large
with 8 cores and 58.4 GiB of memory according to the A
Jason,
Thanks for the notes.
I'm curious whether you went with using local drives (ephemeral storage) or
EBS, and if with EBS then what IOPS.
Thanks,
-- Ken
On May 22, 2013, at 1:42pm, Jason Weiss wrote:
> All,
>
> I asked a number of questions of the group over the last week,
ss EBS volumes per broker?
Thanks again for the great info!
-Jonathan
On Wed, May 22, 2013 at 4:35 PM, Jason Weiss wrote:
> Ken,
>
> Great question! I should have indicated I was using EBS, 500GB with 2000
> provisioned IOPs.
>
> Jason
>
>
cott Clasen [sc...@heroku.com]
Sent: Wednesday, May 22, 2013 19:27
To: users
Subject: Re: Apache Kafka in AWS
Hey Jason,
question what openjdk version did you have issues with? Im running kafka
on it now and has been ok. Was it a crash only at load?
Thanks
SC
On Wed, May 22, 2013 at 1:42 PM, Jas
, 2013, at 3:35pm, Jason Weiss wrote:
> Ken,
>
> Great question! I should have indicated I was using EBS, 500GB with 2000
> provisioned IOPs.
OK, thanks. Sounds like you were pegged on CPU usage.
But that does surprise me a bit. Did you check that you were using all cores?
Thanks,
--
AWS
Jason,
Thanks for sharing. This is very interesting. Normally, Kafka brokers don't
use too much CPU. Are most of the 750% CPU actually used by Kafka brokers?
Jun
On Wed, May 22, 2013 at 6:11 PM, Jason Weiss wrote:
> >>Did you check that you were using all cores?
>
&
with the graphs) in a blog (or a wiki page in
>Kafka)?
>
>Thanks,
>
>Jun
>
>
>On Thu, May 23, 2013 at 2:00 AM, Jason Weiss
>wrote:
>
>> Jun,
>>
>> Here is a screenshot from AWS's statistics (per-minute sampling is the
>> finest granularity I b
Folks,
As I posted to the group here yesterday, my 3 server test in AWS produced an
average of 273,132 events per second with a fixed-size 2K message payload.
(Please see that thread for details.) In order to determine the horizontal
scalability, I added an additional server and MORE producer c
size?
On Thu, May 23, 2013 at 10:12 AM, Jason Weiss wrote:
> Bummer.
>
> Yes, but it will be several days. I'll post back to the forum with a URL
> once I'm done.
>
> Jason
>
>
>
> On 5/23/13 10:11 AM, "Jun Rao" wrote:
>
> >Jaso
used to benchmark open source by any chance?
On Tue, May 28, 2013 at 4:29 PM, Jason Weiss wrote:
> Nope, sorry.
>
>
>
> From: S Ahmed [sahmed1...@gmail.com]
> Sent: Tuesday, May 28, 2013 15:47
> To: users@kafka.apache.org
> Sub
I've seen this error when using OpenJDK - I don't have the exact version in
front of me at the moment. As soon as I switched to the Oracle JDKs, the error
went away. However, in fairness to OpenJDK, others have had success on
different versions of the OpenJDK than what I was using.
It's all in
19 matches
Mail list logo
