Hello,
I'm running a 0.8.0 Kafka cluster of 3 servers. The service that it is
for is not in full production yet, so the data written to cluster is
minimal (seems to average between 100kb/s -> 300kb/s per server). I
have configured Kafka to have a 3 replicas. I am noticing that each
Kafka server is
educed, and see if that has some effect on the traffic.
>>
>> Guozhang
>>
>>
>> On Tue, Feb 4, 2014 at 8:46 PM, Carl Lerche wrote:
>>
>> > Hello,
>> >
>> > I'm running a 0.8.0 Kafka cluster of 3 servers. The service that it is
I'm not really an ops person either. I was using jnettop for this.
On Wednesday, February 5, 2014, S Ahmed wrote:
> Sorry I'm not a ops person, but what tools do you use to monitor traffic
> between servers?
>
>
> On Tue, Feb 4, 2014 at 11:46 PM, Carl Lerche
og4j and see what requests are coming in?
>
> -Jay
>
>
> On Tue, Feb 4, 2014 at 9:51 PM, Carl Lerche wrote:
>
>> Hi Jay,
>>
>> I do not believe that I have changed the replica.fetch.wait.max.ms
>> setting. Here I have included the kafka config as well as a
te:
>
>> On Wed, Feb 05, 2014 at 04:51:16PM -0800, Carl Lerche wrote:
>> > So, I tried enabling debug logging, I also made some tweaks to the
>> > config (which I probably shouldn't have) and craziness happened.
>> >
>> > First, some more context.
so check if the on-disk data size/rate match the network
> traffic?
>
> Thanks,
>
> Jun
>
>
> On Thu, Feb 6, 2014 at 7:48 PM, Carl Lerche wrote:
>
>> So, the "good news" is that the problem came back again. The bad news
>> is that I disabled debug log
pected
data is on the order of 500 kbits per sec.
cheers.
On Thu, Feb 6, 2014 at 9:06 PM, Jun Rao wrote:
> Could you also check if the on-disk data size/rate match the network
> traffic?
>
> Thanks,
>
> Jun
>
>
> On Thu, Feb 6, 2014 at 7:48 PM, Carl Lerche wrote:
>
n Thu, Feb 6, 2014 at 11:44 PM, Carl Lerche wrote:
> Re:
>
>> Could you also check if the on-disk data size/rate match the network
>> traffic?
>
> While I have not explicitly checked this, I would say that the answer
> is no. The network is over 1Gbps and I have setup
$ curl -L
http://repo.maven.apache.org/maven2/org/apache/kafka/kafka_2.8.0/0.8.0/kafka_2.8.0-0.8.0.jar
> kafka_2.8.0-0.8.0.jar
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
100 5189 10
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********/
>
>
> On Fri, Feb 7, 2014 at 2:47 AM,
Hey, thanks so much for pointing this out. I think that this is likely
what is happening for us. I will attempt this fix.
Cheers,
Carl
On Thu, Feb 13, 2014 at 8:01 PM, zhong dong wrote:
> We encountered with this problem, too.
>
> And our problem is that we set the message.max.bytes larger than
11 matches
Mail list logo
