Yeah, and I thought I answered your question? I think the compaction happens when new segments are created.
Sorry if I’m still misunderstanding. > On Jan 19, 2018, at 3:55 PM, Rahul Bhattacharjee <rahul.rec....@gmail.com> > wrote: > > Thanks Matt for the response .I was asking about the log compaction > <https://kafka.apache.org/documentation/#compaction> of kafka topics. > > On Fri, Jan 19, 2018 at 12:36 PM, Matt Farmer <m...@frmr.me> wrote: > >> Someone will need to correct me if I’m wrong, but my understanding is that >> a topic log on disk is divided into segments. Compaction will occur when a >> segment “rolls off” - so when a new active segment is created and the >> previous segment becomes inactive. >> >> Segments can be bounded by size and time in topic and broker configuration >> to get the effect that you want. >> >>> On Jan 19, 2018, at 2:10 PM, Rahul Bhattacharjee < >> rahul.rec....@gmail.com> wrote: >>> >>> Let's say we have a compacted topic (log.cleanup.policy=compact) where >> lot >>> of updates happen for relatively small set of keys. >>> My question is when does the compaction happen. >>> >>> In memtable , when a new update comes for an already existing key in >>> memtable , the value is simple replaced. >>> or, >>> all the updates are associated with a offset , later the memtable is >>> spilled to disk and the deletion happens during compaction phase. >>> >>> thanks, >>> Rahul >> >>
