Hi Eno, The GDPR request we are getting here at linkedin is if we get a request to delete a record through a null key on a log compacted topic, we want to delete the record via compaction in a given time period like 2 days (whatever is required by the policy).
There might be other issues (such as orphan log segments under certain conditions) that lead to GDPR problem but they are more like something we need to fix anyway regardless of GDPR. -- Xiongqi (Wesley) Wu On Mon, Aug 13, 2018 at 2:56 PM, Eno Thereska <eno.there...@gmail.com> wrote: > Hello, > > Thanks for the KIP. I'd like to see a more precise definition of what part > of GDPR you are targeting as well as some sort of verification that this > KIP actually addresses the problem. Right now I find this a bit vague: > > "Ability to delete a log message through compaction in a timely manner has > become an important requirement in some use cases (e.g., GDPR)" > > > Is there any guarantee that after this KIP the GDPR problem is solved or do > we need to do something else as well, e.g., more KIPs? > > > Thanks > > Eno > > > > On Thu, Aug 9, 2018 at 4:18 PM, xiongqi wu <xiongq...@gmail.com> wrote: > > > Hi Kafka, > > > > This KIP tries to address GDPR concern to fulfill deletion request on > time > > through time-based log compaction on a compaction enabled topic: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 354%3A+Time-based+log+compaction+policy > > > > Any feedback will be appreciated. > > > > > > Xiongqi (Wesley) Wu > > >
