Re: Configuration: Retention and compaction

It does not. The current segment is open for writing and only closed (ie, rolled) segments are considered. There is a bunch of broker/topic configs that you can play with to influence log rolling and compaction. -Matthias On 12/8/17 10:53 AM, Dmitry Minkovsky wrote: > Matthias, you read my mind—

Re: Configuration: Retention and compaction

Matthias, you read my mind—having examined Kafka Streams intermediate topic configs and then Googled my way to KIP-71 , I was confused about this dual policy. Thank you. Still wondering abou

Re: Configuration: Retention and compaction

Topic can be configured in "dual" mode too via >> cleanup.policy="delete,compact" For this case, `retention.ms` is basically a TTL for a key that is not updated for this amount of time. -Matthias On 12/3/17 11:54 AM, Jan Filipiak wrote: > Hi > > the only retention time that applies for comp

Re: Configuration: Retention and compaction

Hi the only retention time that applies for compacted topics is the delete.retention.ms The duration that tombstones for deletes will be kept in the topic during compaction. A very detail explaination on what is going on can be found here: https://kafka.apache.org/documentation/#compaction

Configuration: Retention and compaction

This is a pretty stupid question. Mostly likely I should verify these by observation, but really I want to verify that my understanding of the documentation is correct: Suppose I have topic configurations like: retention.ms=$time cleanup.policy=compact My questions are: 1. After $time, any