Some emails don't seem to be delivered to the mailing list. This is just a
test to see if the mailing list still works.
Jun
Hi All,
I have read this posting from linkedIn Team member;
http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/
; Thanks.
I have few questions and thoughts:
1) In asynchronous mode, you are compressing the batch, not the individual
send.
2) There is no way we
We decided to clear the old logs and start fresh. I'll run that app the next
time if we run into the same problem again.
Thanks Jun,
Xuyen
-Original Message-
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Monday, May 12, 2014 8:58 PM
To: users@kafka.apache.org
Subject: Re: IndexOutOfBou
Sure thing - https://issues.apache.org/jira/browse/KAFKA-1452
On May 13, 2014, at 8:33 PM, Jun Rao wrote:
> Yes, that seems like a real issue. Could you file a jira?
>
> Thanks,
>
> Jun
>
>
> On Tue, May 13, 2014 at 11:58 AM, Alex Demidko
> wrote:
>
>> Hi,
>>
>> Kafka version is 0.8.1.1.
In 0.8, the servers and consumers are heavily dependent on ZK to function.
With ZK down, the servers cannot manage replicas and consumers cannot
assign partitions within the group.
In 0.9 we are going to remove the ZK dependency from consumer clients, but
Kafka servers would still be dependent on
Take a look at ConsumerLag jmx in
http://kafka.apache.org/documentation.html#monitoring
Thanks,
Jun
On Wed, May 14, 2014 at 2:17 AM, Simon Cooper <
simon.coo...@featurespace.co.uk> wrote:
> In the output of kafka-topics.sh -describe, it gives the ISR. What I want
> to find out is why a particu
Weide,
Kafka servers are heavily dependent on ZK, hence when it is down the
servers will be in a bad state, and handling produce/fetch requests could
be mal-functioned.
Guozhang
On Tue, May 13, 2014 at 1:02 PM, Weide Zhang wrote:
> Can kafka survive when zookeeper is down and not connectable
Yes, there has been a few issues reported related to message latency. We
are fixing that in https://issues.apache.org/jira/browse/KAFKA-1430
Thanks,
Jun
On Wed, May 7, 2014 at 7:30 AM, Simon Cooper <
simon.coo...@featurespace.co.uk> wrote:
> I've got a very strange bug doing a long poll using
I understand Kafka supports keyed messages (I am using 0.8.1.1) and it is
possible to de-duplicate messages based on the message key.
(The log compaction section of the on-line documentation described how that
works.)
I am using a code example that come with Kafka (namely
KafkaConsumerProducerDem
The C# client you're using only supports 0.7 Kafka, where 0.8 kafka is
not backward compatible APIs anymore.
If you want to use the latest Kafka you'll have to change the binary
protocol yourself, or work with one of the other folks that has
mentioend about .NET client in the mailing list.
Tim
O
Hi Kafka Team,
Is there any message size limitation from producer side ? If there, is
what happens to message, does it get truncated or message is lost ?
Thanks,
Bhavesh
It looks like the log.cleanup.policy config option was changed from "dedupe" to
"compact".
https://github.com/apache/kafka/blob/0.8.1.1/core/src/main/scala/kafka/log/LogConfig.scala#L68
-Jon
On May 13, 2014, at 1:08 PM, Jay Kreps wrote:
> Hi,
>
> The compaction is done to clean-up space. It
12 matches
Mail list logo
