2015-03-01 18:41 GMT+03:00 Jay Kreps <jay.kr...@gmail.com>: > They are mutually exclusive. Can you expand on the motivation/use for > combining them?
Thanks, Jay Let's say we need to build key-value storage semantically connected to the data that also stored in kafka. Once the particular pieces of data are gone due to retention expiration there might be no need to keep relevant pieces in the kv-storage. On the other hand, kv-storage most likely will benefit from compaction, since its keys receive multiple updates. If this is not available oob, looks like the same can now be achieved by manually scanning compacted topic and issuing "delete" markers.
