[ceph-users] Re: Pool Migration / Import/Export

2023-12-13 Thread Chris Dunlop
On Mon, Dec 11, 2023 at 05:27:53PM +1100, duluxoz wrote: Hi All, I find myself in the position of having to change the k/m values on an ec-pool. I've discovered that I simply can't change the ec-profile, but have to create a "new ec-profile" and a "new ec-pool" using the new values, then migr

[ceph-users] Terrible cephfs rmdir performance

2023-12-13 Thread Paul Mezzanini
Long story short, we've got a lot of empty directories that I'm working on removing. While removing directories, using "perf top -g" we can watch the MDS daemon go to 100% cpu usage with "SnapRealm:: split_at" and "CInode::is_ancestor_of". It's this 2 year old bug that still is around. https:/

[ceph-users] Re: Is there any way to merge an rbd image's full backup and a diff?

2023-12-13 Thread Ilya Dryomov
On Wed, Dec 13, 2023 at 12:48 AM Satoru Takeuchi wrote: > > Hi Ilya, > > 2023年12月12日(火) 21:23 Ilya Dryomov : > > Not at the moment. Mykola has an old work-in-progress PR which extends > > "rbd import-diff" command to make this possible [1]. > > I didn't know this PR. Thank you very much.I'll eval

[ceph-users] MDS crashing repeatedly

2023-12-13 Thread Thomas Widhalm
Hi, I have a 18.2.0 Ceph cluster and my MDS are now crashing repeatedly. After a few automatic restart, every MDS is removed and only one stays active. But it's flagged "laggy" and I can't even start a scrub on it. In the log I have this during crashes: Dec 13 15:54:02 ceph04 ceph-ff6e50de-

[ceph-users] Ceph orch made block_db too small, not accounting for multiple nvmes, how-to fix it?

2023-12-13 Thread Mikael Öhman
Hi Our hosts have 3 NVMEs and 48 spinning drives each. We found that ceph orch made the default lvm size for the block_db 1/3 the total size of the NVMEs. I suspect that ceph only considered one of the NVMEs when determining the size, based the closely related issue; https://tracker.ceph.com/issue

[ceph-users] Re: Etag change of a parent object

2023-12-13 Thread Daniel Gryniewicz
On 12/13/23 05:27, Janne Johansson wrote: Den ons 13 dec. 2023 kl 10:57 skrev Rok Jaklič : Hi, shouldn't etag of a "parent" object change when "child" objects are added on s3? Example: 1. I add an object to test bucket: "example/" - size 0 "example/" has an etag XYZ1 2. I add an object

[ceph-users] Re: How to configure something like osd_deep_scrub_min_interval?

2023-12-13 Thread Frank Schilder
Hi all, since there seems to be some interest, here some additional notes. 1) The script is tested on octopus. It seems that there was a change in the output of ceph commands used and it might need some tweaking to get it to work on other versions. 2) If you want to give my findings a shot, yo

[ceph-users] Re: increasing number of (deep) scrubs

2023-12-13 Thread Frank Schilder
Yes, octopus. -- Frank = Frank Schilder AIT Risø Campus Bygning 109, rum S14 From: Szabo, Istvan (Agoda) Sent: Wednesday, December 13, 2023 6:13 AM To: Frank Schilder; ceph-users@ceph.io Subject: Re: [ceph-users] Re: increasing number of (d

[ceph-users] cephfs read hang after cluster stuck, but need attach the process to continue

2023-12-13 Thread zxcs
Hi, experts, we are using cephfs with 16.2.* with multi active mds, and recently we see a strange thing, we have some c++ code about read file from cephfs. the client code just call very base read(), and when the cluster hit mds has slow request, and later the cluster back to normal. the r

[ceph-users] Re: Etag change of a parent object

2023-12-13 Thread Janne Johansson
Den ons 13 dec. 2023 kl 10:57 skrev Rok Jaklič : > Hi, > > shouldn't etag of a "parent" object change when "child" objects are added > on s3? > > Example: > 1. I add an object to test bucket: "example/" - size 0 > "example/" has an etag XYZ1 > 2. I add an object to test bucket: "example/test1.

[ceph-users] Re: Disable signature url in ceph rgw

2023-12-13 Thread Marc Singer
Hi As my attachment is very messy, I cleaned it up and provide a much simpler version for your tests bellow. These policies seem to get ignored when the URL is presigned. { "Version":"2012-10-17", "Id":"userbucket%%%policy", "Statement":[ { "Sid":"username%%%read",

[ceph-users] Etag change of a parent object

2023-12-13 Thread Rok Jaklič
Hi, shouldn't etag of a "parent" object change when "child" objects are added on s3? Example: 1. I add an object to test bucket: "example/" - size 0 "example/" has an etag XYZ1 2. I add an object to test bucket: "example/test1.txt" - size 12 "example/test1.txt" has an etag XYZ2 "examp

[ceph-users] Re: Cephfs too many repaired copies on osds

2023-12-13 Thread Eugen Block
Your disk is most likely slowly failing, you should check smart values and dmesg output for read/write errors and probably replace the disk. Zitat von zxcs : Also osd frequently report these ERROR logs, lead this osd has slow request. how to stop these log ? “full object read crc *** != e