Yujie Li created KAFKA-13732:
Summary: Improve offsets.retention.minutes document to specify
it's consumer per topic instead whole consumer group
Key: KAFKA-13732
URL: https://issues.apache.org/jira/browse/
of log.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
> URL: https://issues.apache.org/jira/browse/KAFKA-3806
> Project: Kafka
> Is
not make it the default anyway.
> Adjust default values of log.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
> URL: https://issues.apache.org/jira/browse/KAFKA-3806
ween log.retention.hours and
offsets.retention.minutes through experience rather than documentation. Then
they search the internet for clues until they come upon this ticket. _If the
Kafka cluster sets both properties to the same duration_ (accounting for hours
vs minutes), then you have a st
d reduce this value.
> Adjust default values of log.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
> URL: https://issues.apache.org/jira/browse/KAFKA
ound the issue by prolonging
offsets.retention.minutes, it seems safe in our environment.
> Adjust default values of log.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
>
the broker can efficiently tell the consumer
what its most recent offset was.
If you set the offsets.retention.minutes to a very large value, you will end up
with fewer garbage collections, which means the in-memory aggregate size will
be larger.
> Adjust default values of log.re
g those tools for a short period of time, it would be useful
to garbage collect the unused offsets. If you know this is not the case, you
can increase offsets.retention.minutes.
Yes, ideally, perhaps we should only start the expiration clock once the
consumer becomes inactive, instead when an offse
= 7 days is pretty fine, but I would expect default
for offsets.retention.minutes to be half a year or so. Remember it is basically
only reasonably small group of tiny numbers. Can you explain me, what is the
reason to have offsets.retention.minutes so small, only 1 day? What will be the
consequ
;t see a reason why would anybody prefer this over a saner default
that would be closer to the default retention (time) value. Thanks
> Adjust default values of log.retention.hours and offsets.retention.minutes
> --
>
og.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
> URL: https://issues.apache.org/jira/browse/KAFKA-3806
> Project: Kafka
> Issue Type: Improvement
&g
l is likely too frequent and will
add unnecessary load on the broker. So, committing offsets in some configured
time interval will be better.
The retention is done per topic/partition. If the last committed offset for a
given topic/partition hasn't been updated for longer than
offsets.retentio
[
https://issues.apache.org/jira/browse/KAFKA-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321422#comment-15321422
]
James Cheng commented on KAFKA-3806:
Does the offsets.retention.minutes timer a
.retention.hours and offsets.retention.minutes
> --
>
> Key: KAFKA-3806
> URL: https://issues.apache.org/jira/browse/KAFKA-3806
> Project: Kafka
> Issue Type: Imp
[
https://issues.apache.org/jira/browse/KAFKA-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320931#comment-15320931
]
Jun Rao commented on KAFKA-3806:
----
offsets.retention.minutes is designed to handle the
Michal Turek created KAFKA-3806:
---
Summary: Adjust default values of log.retention.hours and
offsets.retention.minutes
Key: KAFKA-3806
URL: https://issues.apache.org/jira/browse/KAFKA-3806
Project
>> I read the reasoning about using offsets.retention.minutes at
>> https://mail-archives.apache.org/mod_mbox/kafka-users/201602.mbox/%3ccaaofhrah8p_a1yebfnh4wzsjwgiqpob_pr6hn4nymtluqqb...@mail.gmail.com%3E,
>> but can we agree that the original reason behind
?
On Fri, Apr 1, 2016 at 11:29 PM, William Grim wrote:
> Hi,
>
> I read the reasoning about using offsets.retention.minutes at
> https://mail-archives.apache.org/mod_mbox/kafka-users/201602.mbox/%3ccaaofhrah8p_a1yebfnh4wzsjwgiqpob_pr6hn4nymtluqqb...@mail.gmail.com%3E,
> but ca
Hi,
I read the reasoning about using offsets.retention.minutes at
https://mail-archives.apache.org/mod_mbox/kafka-users/201602.mbox/%3ccaaofhrah8p_a1yebfnh4wzsjwgiqpob_pr6hn4nymtluqqb...@mail.gmail.com%3E,
but can we agree that the original reason behind it is wrong? In my
personal world view
19 matches
Mail list logo
