Re: configuring log compaction

2015-08-09 Thread David Judd
Ok. I think that actually works fine for my use case. Thanks! On Sun, Aug 9, 2015 at 4:26 PM, Jiangjie Qin wrote: > Actually Kafka only support two mutually exclusive log cleanup policy: 1) > delete logs after retention period passed. 2) compact the log to only keep > the last updated value of a

Re: configuring log compaction

2015-08-09 Thread Jiangjie Qin
Actually Kafka only support two mutually exclusive log cleanup policy: 1) delete logs after retention period passed. 2) compact the log to only keep the last updated value of a key. log.retention.hours is only used by (1). For log compaction, currently it is not compacting the logs by its age, but

configuring log compaction

2015-08-09 Thread David Judd
Hi, I have a beginner's question. I'd like to confirm that I'm interpreting the docs correctly. My goal is a setup where, by default, logs are compacted after 7 days and the compacted records are retained indefinitely. Does the following combination of settings achieve this? log.retention.hours=