[ceph-users] RGW bucket notifications stop working after a while and blocking requests

2024-08-05 Thread Florian Schwab
Hi, we just set up 2 new ceph clusters (using rook). To do some processing of the user activity we configured a topic that sends events to Kafka. After 5-12 hours this stops working with a 503 SlowDown response: debug 2024-08-02T09:17:58.205+ 7ff4359ad700 1 req 13681579273117692719 0.005000

[ceph-users] Re: [EXTERNAL] RGW bucket notifications stop working after a while and blocking requests

2024-08-05 Thread Florian Schwab
gt; would surely be interesting to see what is in the queue. > > Best wishes, > Alex > > From: Florian Schwab <mailto:fsch...@impossiblecloud.com>> > Sent: Monday, August 5, 2024 11:02 AM > To: ceph-users@ceph.io <mailto:ceph-users@ceph.io> <mailto:ceph-users@c

[ceph-users] Re: [EXTERNAL] RGW bucket notifications stop working after a while and blocking requests

2024-08-06 Thread Florian Schwab
024, at 14:38, Florian Schwab wrote: > > Hi Alex, > > thank you for the script. We will monitor how the queue fills ups to see if > this is the issue or not. > > > Cheers, > Florian > >> On 5. Aug 2024, at 14:01, Alex Hussein-Kershaw (HE/HIM) >>

[ceph-users] RGW bucket notifications stop working after a while and blocking requests

2024-08-06 Thread Florian Schwab
Hi, we just set up 2 new ceph clusters (using rook). To do some processing of the user activity we configured a topic that sends events to Kafka. After 5-12 hours this stops working with a 503 SlowDown response: debug 2024-08-02T09:17:58.205+ 7ff4359ad700 1 req 13681579273117692719 0.005000

[ceph-users] bilog trim fails with "No such file or directory"

2024-09-11 Thread Florian Schwab
Hi everyone, I hope maybe someone here has an idea what is happening here or can give some pointers how to debug it further. We currently have a bucket which has large omap objects. Following this guide (https://access.redhat.com/solutions/6450561) we are able to identify the bucket etc. $ ce

[ceph-users] Re: bilog trim fails with "No such file or directory"

2024-09-11 Thread Florian Schwab
gt; Which Ceph release? How many OSDs and how many PBs in the index pool? > Auto-resharding enabled? > >> On Sep 11, 2024, at 10:24 AM, Florian Schwab >> wrote: >> >> Hi everyone, >> >> I hope maybe someone here has an idea what is happening he

[ceph-users] Increase amount of OSDs on nodes

2025-04-24 Thread Florian Schwab
Hi everyone, I’m currently facing the following challenge were I’d like to hear what the community thinks on how to solve it. We have a ceph cluster (only using RGW) with which we had some performance issues when initially setting it up and instead of using all 60 HDDs installed in each server