https://issues.apache.org/jira/browse/KAFKA-1647 sounds serious enough to
include in 0.8.2-beta if possible.
CONFIDENTIALITY NOTICE This message and any included attachments are from
Cerner Corporation and are intended only for the addressee. The information
contained in this message is confide
After a recent 0.8.2.1 upgrade we noticed a significant increase in used
filesystem space for our Kafka log data. We have another Kafka cluster still on
0.8.1.1 whose Kafka data is being copied over to the upgraded cluster, and it
is clear that the disk consumption is higher on 0.8.2.1 for the s
and recompresses them
>into a single compressed message.
>
>Are you using mirror maker to copy data from the 0.8.1 cluster to the
>0.8.2
>cluster? If so, this may have to do with the batching in the producer in
>mirror maker. Did you enable the new java producer in mirror maker?
>
&g
unclean.leader.election.enable is actually a valid topic-level configuration, I
opened https://issues.apache.org/jira/browse/KAFKA-3298 to get the
documentation updated.
That code comment doesn’t tell the complete story and could probably be updated
for clarity as we’ve learned a lot since t
A very high retention time (e.g. 50 years in milliseconds) would effectively
accomplish this.
On 3/1/16, 8:39 AM, "Roshan Punnoose" wrote:
>Hi,
>
>Is it possible to set up a topic with only a size limit (retention.bytes)
>and not a time limit (retention.ms)?
>
>Roshan
CONFIDENTIALITY NOTICE
This topic is currently being discussed at
https://issues.apache.org/jira/browse/KAFKA-2986 and
https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records
On 3/2/16, 8:11 AM, "Vanessa Gligor" wrote:
>Hello,
>
>I am using Kafka higher consumer 0.9.0. I am not using t
You might take a look at the KafkaServerTestHarness [1] if you’re not already
familiar with it. It’s not exactly “mock”, but it makes it easy to test Kafka
functionality without needing to connect to any external broker or ZK
processes. We ported this test harness to Java for our junit and integ
