[ceph-users] Re: DB/WALL and RGW index on the same NVME

Hi Lukasz, RGW uses Omap objects for the index pool; Omaps are stored in Rocksdb database of each osd, not on the actual index pool, so by putting DB/WALL on an NVMe as you mentioned, you are already configuring the index pool on a non-rotational drive, you don't need to do anything else. You jus

[ceph-users] Re: MDS Behind on Trimming...

Ah, I see. Yes, we are already running version 18.2.1 on the server side (we just installed this cluster a few weeks ago from scratch). So I guess if the fix has already been backported to that version, then we still have a problem. Dos that mean it could be the locker order bug (https://trac

[ceph-users] Re: MDS Behind on Trimming...

Hi Erich, On Mon, Apr 8, 2024 at 11:51 AM Erich Weiler wrote: > > Hi Xiubo, > > > Thanks for your logs, and it should be the same issue with > > https://tracker.ceph.com/issues/62052, could you try to test with this > > fix again ? > > This sounds good - but I'm not clear on what I should do? I

[ceph-users] Re: MDS Behind on Trimming...

Hi Xiubo, Thanks for your logs, and it should be the same issue with https://tracker.ceph.com/issues/62052, could you try to test with this fix again ? This sounds good - but I'm not clear on what I should do? I see a patch in that tracker page, is that what you are referring to? If so, ho

[ceph-users] Re: MDS Behind on Trimming...

Hi Erich, Thanks for your logs, and it should be the same issue with https://tracker.ceph.com/issues/62052, could you try to test with this fix again ? Please let me know if you still could see this bug then it should be the locker order bug as https://tracker.ceph.com/issues/62123. Thanks

[ceph-users] DB/WALL and RGW index on the same NVME

Hi! I'm working on a POC cluster setup dedicated to backup app writing objects via s3 (large objects, up to 1TB transferred via multipart upload process). Initial setup is 18 storage nodes (12HDDs + 1 NVME card for DB/WALL) + EC pool. Plan is to use cephadm. I'd like to follow good practice and

[ceph-users] Multiple MDS Daemon needed?

Hi All, We have a slurm cluster with 25 clients, each with 256 cores, each mounting a cephfs filesystem as their main storage target. The workload can be heavy at times. We have two active MDS daemons and one standby. A lot of the time everything is healthy but we sometimes get warnings ab