Re: [DISCUSS] KIP-405: Kafka Tiered Storage

We already mentioned in the KIP that RemoteLogMetadataMamnager is pluggable. Users have an option to plugin their own implementation of RLMM instead of using the default implementaion(which is on topic storage), which can be based on their remote storage environments like AWS, GCP, Azure etc. On S

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Colin, Thanks for looking into the KIP. I guess you are talking about the option mentioned for a cache used in the default implementation of RemoteLogMetadataManager. RocksDB is put as an option of cache for the initial version of the default implementation because it is easy and works with th

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Hi Unmesh, That's an interesting idea, but I think it would be best to strive for single metadata events that are complete in themselves, rather than trying to do something transactional or EOS-like. For example, we could have a create event that contains all the partitions to be created. bes

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

On Fri, Jul 10, 2020, at 18:15, Guozhang Wang wrote: > Hello Colin, > > Thanks for the nice written KIP. A few meta comments: > > 1) We need to talk a bit about broker failure detection: is that piggy > backed with fencing? i.e. should the controller immediately migrate leader > partitions from t

[VOTE] KIP-614: Add Prefix Scan support for State Stores

Hi All, I would like to start a new voting thread for the below KIP to add prefix scan support to state stores: https://cwiki.apache.org/confluence/display/KAFKA/KIP- 614%3A+Add+Prefix+Scan+support+for+State+Stores