Re: Kafka compacted topic question.

2018-01-20 Thread Rahul Bhattacharjee
to compact eligible > segment. > > > Note: I still didn't answer your question of "why this behavior?". Just > shared my understanding to maintain updated values. > > Thank you, > Naresh > > > > > On Sat, Jan 20, 2018 at 7:47 AM Rahul Bhattacharj

Re: Kafka compacted topic question.

2018-01-20 Thread Rahul Bhattacharjee
n > happens when new segments are created. > > > > Sorry if I’m still misunderstanding. > > > >> On Jan 19, 2018, at 3:55 PM, Rahul Bhattacharjee < > rahul.rec@gmail.com> wrote: > >> > >> Thanks Matt for the response .I was asking about the

Re: Kafka compacted topic question.

2018-01-19 Thread Rahul Bhattacharjee
> > > On Jan 19, 2018, at 2:10 PM, Rahul Bhattacharjee < > rahul.rec@gmail.com> wrote: > > > > Let's say we have a compacted topic (log.cleanup.policy=compact) where > lot > > of updates happen for relatively small set of keys. > > My questio

Kafka compacted topic question.

2018-01-19 Thread Rahul Bhattacharjee
Let's say we have a compacted topic (log.cleanup.policy=compact) where lot of updates happen for relatively small set of keys. My question is when does the compaction happen. In memtable , when a new update comes for an already existing key in memtable , the value is simple replaced. or, all the u