[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

I failed to reproduce this issue in Reef 18.2.4. So I think this is a Squid regression of the notification v1 functionality. In Reef, all the notification and topic config remains on the site it was created on. I raised: Bug #68227: rgw/notifications: notifications and topics appear on multisi

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

Sadly I think I've found another issue here that prevents my use case even with notifications_v2 disabled. My repro scenario: * Deployed a fresh multisite Ceph cluster at 19.1.1 (siteA is the master, siteB is non-master) * Immediately disabled notifications_v2 and update/commit the period.

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

Thanks 🙂 I've raised: Bug #68102: rgw: "radosgw-admin topic list" may contain duplicated data and redundant nesting - rgw - Ceph Enhancement #68104: rgw: Add a "disable replication" flag to bucket notification configuration - rgw - Ceph

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

This is really an application level problem, but it's not trivial for me to determine the name of the remote site. So while I could add a metadata header and include the site name, then use "x-amz-metadata-site" == remote_site_name as my filter, it would be much more practical to say "x-amz-meta

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

inline On Mon, Sep 16, 2024 at 5:13 PM Alex Hussein-Kershaw (HE/HIM) < alex...@microsoft.com> wrote: > Yes - that's correct. Thanks for the suggestions. > > I think the metadata suggestion probably does work, however it doesn't > come easy for me as it seems not possible to do a negative match fi

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

Yes - that's correct. Thanks for the suggestions. I think the metadata suggestion probably does work, however it doesn't come easy for me as it seems not possible to do a negative match filter; what I would really like to do is setup a filter for objects where "x-amz-metadata-site" != "local-si

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

just to see that i got it right. you are asking to disable the topic and notification replication. as you want to send to different topics based on the zone that got the update to the bucket? * one option is to disable "notifications_v2" on the zonegroup. but, this is probably not a good idea - t

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

Following up on this, I've run into another issue during my prototyping. I have two Ceph Clusters, with a zone each, sharing a zonegroup and realm. I have a local application to each, that needs informed of replication changes. So I've created a topic and notification per site. Given the notific

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

responded inline On Tue, Sep 3, 2024 at 3:05 PM Alex Hussein-Kershaw (HE/HIM) < alex...@microsoft.com> wrote: > Hi Yuval, > > Thanks for the response. I did managed to disable the feature, however I > hope you can understand my hesitancy to design our move away from pubsub > onto a deprecated rep

[ceph-users] Re: [EXTERNAL] Re: Bucket Notifications v2 & Multisite Redundancy

Hi Yuval, Thanks for the response. I did managed to disable the feature, however I hope you can understand my hesitancy to design our move away from pubsub onto a deprecated replacement (i.e. "notifications v1"). The difference between this and the other operations that require forwarding to t