ink. I think
> the default is something like 1 or 3 so it will try a few times then give
> up.
>
> -Jay
>
> On Mon, Oct 27, 2014 at 6:01 PM, Libo Yu wrote:
>
> > This seems to be a bug of 0.8.1
> > More info:
> > queue.enqueue.timeout.ms is explicitly set to
Congrats! When do you think the final 0.82 will be released?
> To: annou...@apache.org; users@kafka.apache.org; d...@kafka.apache.org
> Subject: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released
> Date: Tue, 28 Oct 2014 00:50:35 +
> From: joest...@apache.org
>
> The Apache Kafka community is pl
This seems to be a bug of 0.8.1
More info:
queue.enqueue.timeout.ms is explicitly set to -1.
queue.buffering.max.messages is explicitly set o 1.
But still, when the net cable was unplugged, the producer did not block at all
and
all messages were "sent".
> From: yu_l...@hotmail.com
> To: u
Hi team,
I am testing async publishing + acknowledgement.
Assume all settings are the default and queue.buffering.max.messages is 10k. I
use a simple for loop to publish 100k messages. In the process, I unplugged the
net cable.
What should I expect in this case?
I assume the send will be bloc
on each
> message sent asynchronously.
>
> Thanks,
>
> Jun
>
> On Thu, Oct 23, 2014 at 3:26 PM, Libo Yu wrote:
>
> > Hi,
> >
> > If I use async publishing plus message acknowledgement,
> > is there any API to tell when all the messages in
Hi,
If I use async publishing plus message acknowledgement,
is there any API to tell when all the messages in the queue
have been sent out?
This will be used in the shutdown hook to make sure when
the process is down there is no pending messages to be
published.
Thanks,
Libo
a.apache.org
>
> Which example are you referring to?
>
> On Mon, Oct 20, 2014 at 7:47 AM, Libo Yu wrote:
>
> > Hi all,
> >
> >
> > This config property does not appear in the table of broker config
> > properties. But it appears in the example on the
Hi all,
This config property does not appear in the table of broker config properties.
But it appears in the example on the Web page. So I wonder if this is still a
valid config property for 0.8.1. Thanks.
Libo
uozhang
>
>
> On Sat, Jun 7, 2014 at 7:24 AM, Libo Yu wrote:
>
> > Hi Guozhang,
> >
> > The issue is not constantly to reproduce but fairly easy to reproduce.
> > It seems there is some kind of failure that has not been captured by the
> > Kaf
hould be
> either thrown as exceptions or logged in warning/error log entries.
>
> Guozhang
>
>
> On Thu, Jun 5, 2014 at 6:38 PM, Libo Yu wrote:
>
> > Not really. The issue was reported by a client. I added a lot of logging
> > to make sure no exception was th
time.
> Date: Thu, 5 Jun 2014 16:53:29 -0700
> Subject: Re: question about synchronous producer
> From: wangg...@gmail.com
> To: users@kafka.apache.org
>
> Libo, did you see any exception/error entries on the producer log?
>
> Guozhang
>
>
> On Thu, Jun 5,
; Guozhang
>
>
> On Thu, Jun 5, 2014 at 10:03 AM, Libo Yu wrote:
>
> > When all the brokers are down the producer should retry for a few times
> > and throw FailedToSendMessageException. And user code can catch the
> > exception and retry after a backoff. However,
rop the message on the
> floor. So when the broker is down for too long there will be data loss.
>
> Guozhang
>
>
> On Thu, Jun 5, 2014 at 6:20 AM, Libo Yu wrote:
>
> > I want to know why there will be message loss when brokers are down for
> > too long.
>
gt; Guozhang
>
>
> On Thu, May 29, 2014 at 2:55 PM, Libo Yu wrote:
>
> > Hi team,
> >
> > Assume I am using a synchronous producer and it has the following default
> > properties:
> >
> > message.send.max.retries
> > 3
> > retr
wangg...@gmail.com
> > To: users@kafka.apache.org
> >
> > Libo,
> >
> > That is correct. You may want to increase the retry.backoff.ms in this
> > case. In practice, if the brokers are down for too long, then data loss is
> > usually inevit
if the brokers are down for too long, then data loss is
> usually inevitable.
>
> Guozhang
>
>
> On Thu, May 29, 2014 at 2:55 PM, Libo Yu wrote:
>
> > Hi team,
> >
> > Assume I am using a synchronous producer and it has the following de
Hi,
Assume I am using a synchronous producer and request.required.acks is set to 0
(default).
When java api Producer.send(message) returns, is the message acknowledged? Is
there any
chance of message loss in the case? Thanks.
Libo
Hi team,
Assume I am using a synchronous producer and it has the following default
properties:
message.send.max.retries
3
retry.backoff.ms
100
I use java api Producer.send(message) to send a message.
While send() is being called, if the brokers are shutdown, what happens?
send() wi
Please forget the cause i found in my previous email. it is not true. i will
keep investigating this issue.
From: yu_l...@hotmail.com
To: users@kafka.apache.org
Subject: 0.8.1 cpu usage
Date: Wed, 30 Apr 2014 11:10:07 -0400
Hi team,
We have noticed that the cpu usage of 0.8.1 has more than
Hi team,
We have noticed that the cpu usage of 0.8.1 has more than doubled compared to
beta1. I captured a thread dump and compared source code. I believe the higher
cpu usage is introduced by the change of timeout value used by
selector.select() in SocketServer.scala.In beta1 it is 500ms. In 0
Hi all,
To test 0.8.1, I recently upgraded our kafka from 0.8-beta1 to 0.81 on three
clusters. On all three of them,
I've noticed high cpu usage (20% to more than 70%). Our production is using
0.8-beta with the
same configuration and does not have this issue. I wonder if other people have
rep
Hi team,
The following link introduces a script for adding a partition.
https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionTool
However, in the downloaded package, I did not find kafka-add-partitions.sh.
Is it disabled? It is desirable to add partit
Hi team,
I remember for kafka 0.8, there is a kafka jar with all the dependencies in it.
0.81 does not seem to have a jar. Can anybody confirm that? Thanks.
Libo
Hi team,
We are using Kafka 0.8-beta1. The zookeeper in it is 3.3.3 (although the
version in the license file is 3.3.4).
I want to upgrade to a newer version. Any idea what I need to do in order to
compile broker with a newer version
of zookeeper? Thanks.
Libo
24 matches
Mail list logo
