Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-11-03 Thread Jianfeng Lin
Thank you for your detailed answer, Kamal. Yes, I may prefer to upgrade to Kraft mode, but do you think the migration is stable and well-verified by other users? I was thinking to delete the verification in LogConfig#validateNoInvalidRemoteStorageConfigsInZK and adjust unit tests as you said, bec

Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-11-03 Thread Jianfeng Lin
I see I see, Thanks for answering my questions Luke, I'll discuss with my team for upgrading to kraft if it takes less cost than enabling in zk mode. On Wed, Oct 30, 2024 at 3:25 PM Luke Chen wrote: > Hi Jianfeng, > > The reason we don't support ZK mode is because the ZK is going to be > remov

Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-11-02 Thread Kamal Chandraprakash
For shortcoming (2), looking at the code, as long as the partition is not offline during disablement (leader is available), then the remote-log deletion might proceed as expected. Note that the feature is not tested out in ZK mode, and the implementation details can change later. So, I'd suggest yo

Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-11-02 Thread Kamal Chandraprakash
Hi Jianfeng, As Luke already mentioned, the feature was not tested in ZK mode. If you still want to enable it in the ZK mode, then: 1. Disable the LogConfig#validateNoInvalidRemoteStorageConfigsInZK

Re: Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-10-30 Thread Luke Chen
Hi Jianfeng, The reason we don't support ZK mode is because the ZK is going to be removed in v4.0.0, so we decided to only implement it in KRaft mode. > I read the source code and seems kafka broker only updates the LogConfig and then invokes maybeUpdateRemoteLogComponents to cancel some tasks. S

Kafka Tiered Storage Disablement Implement in ZK Mode Question

2024-10-27 Thread Jianfeng Lin
Hi kafka community, I read the KIP-950 which describe the disablement of kafka tiered storage. It said that zk mode won't be supported and