[DISCUSS] Release Pulsar Client Go 0.15.0

2024-12-23 Thread Zixuan Liu
Hi all, I would like to release the Pulsar Client Go 0.15.0. https://github.com/apache/pulsar-client-go/milestone/17?closed=1 Thanks, Zixuan

[DISCUSS][Cherry-pick] #23757 makes replicateSubscriptionState nullable

2024-12-23 Thread Zixuan Liu
Hi all, #23757 makes replicateSubscriptionState nullable, which is important for supporting subscription replication on the namespace and topic levels. So I want to cherry-pick #23757 to the branch-3.0, branch-3.3, branch-4.0. Thanks, Zixuan

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread Zixuan Liu
Thanks for your explanation. The users should upgrade the client to ensure the subscription will be replicated when the namespace or topic level is set, this is the best practice. Thanks, Zixuan PengHui Li 于2024年12月24日周二 13:03写道: > > This depends on the consumer's `replicateSubscriptionState` v

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread PengHui Li
> This depends on the consumer's `replicateSubscriptionState` value, when the consumer restarts with true or false, this subscription replication configuration will be reverted, and when there are multiple tenants, namespace, topic, and subscription, this workload is tedious. So I mentioned befor

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread Zixuan Liu
> The reason is we don't have consumer-level control of the replicate subscription state, it's subscription-level control. Correct. > With this solution, you can enable or disable the replicate subscription state with Admin API for the existing topics/subscriptions. This depends on the consumer'

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread Zixuan Liu
In the progress. Lari Hotari 于2024年12月23日周一 16:20写道: > This PIP is very useful. > > One weakness of this PIP is that it would require client upgrades before it > would be effective. > To achieve the desired outcome, I think it would be useful to have a way to > override the consumer-side setting

Re: [DISCUSS] Add an optional config to disable the feature that compresses cursor metadata, which contributed by #9292

2024-12-23 Thread Yubiao Feng
Hi Penghui > And for the feature version release, user should also able to downgrade from 4.x to 3.x without any compatibility issues, so for any feature releases between 4.0 to 5.0 should also disable it by default. > Cherry-pick to 3.0 sounds good to me with disabled by default, but we need to h

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread PengHui Li
Hi Zixuan, Thanks for bringing the discussion here. After going through the context and discussions from https://github.com/apache/pulsar/pull/23770 and https://github.com/apache/pulsar/pull/23769. It looks like we can improve the option "replicateSubscriptionState" to make it only work for the ne

Re: [DISCUSS] Add an optional config to disable the feature that compresses cursor metadata, which contributed by #9292

2024-12-23 Thread PengHui Li
Hi Yubiao, Thanks for driving this fix. Based on the LTS version strategy, user should able to upgrade from 3.0 to 4.0 without and compatibility issues and downgrade from 4.0 to 3.0 without any compatibility issues. https://pulsar.apache.org/contribute/release-policy/#compatibility-between-releas

Re: [DISCUSS] Add an optional config to disable the feature that compresses cursor metadata, which contributed by #9292

2024-12-23 Thread Baodi Shi
+1 #9292 Thanks, Baodi Shi Yubiao Feng 于2024年12月23日周一 11:56写道: > > Hi all > > ## Background > PR #9292 improved the serialization for cursor metadata, which reduces > Young GC and makes Pulsar persist more ack records of the cursor, but it > also caused two issues below > > **Issue-1: Downgrade

Re: [DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread Lari Hotari
This PIP is very useful. One weakness of this PIP is that it would require client upgrades before it would be effective. To achieve the desired outcome, I think it would be useful to have a way to override the consumer-side setting and enable subscription replication for all topics in a namespace,

[DISCUSS] PIP-398: Subscription replication on the namespace and topic levels

2024-12-23 Thread Zixuan Liu
Hi, Pulsar community, Subscription replication is an important feature in the failover scenario, I made a PIP to add the subscription replication feature on the namespace and topic levels. PIP: https://github.com/apache/pulsar/pull/23770 Thanks, Zixuan