[ceph-users] Re: OSD META Capacity issue of rgw ceph cluster

2024-11-08 Thread Frédéric Nass
You may be facing this "BlueFS files take too much space" bug [1]. Have a look at the figures in the PR [2]. Fix hasn't been merged to Reef yet. Regards, Frédéric. [1] [ https://tracker.ceph.com/issues/68385 | https://tracker.ceph.com/issues/68385 ] [2] [ https://github.com/ceph/ceph/pull

[ceph-users] Re: OSD META Capacity issue of rgw ceph cluster

2024-11-07 Thread Jaemin Joo
Thank you for your response. I will test it and left the result. How about the bluestore_rocksdb_options ? I don't understand why rocksdb has a lot of log data in sst file permanently except file metadata. I think some of log data needs to be rotated and left recent log data. I found rocksdb optio

[ceph-users] Re: OSD META Capacity issue of rgw ceph cluster

2024-11-07 Thread Frédéric Nass
Hi, You could give rocksdb compression a try. It's safe to use since Pacific and it's now enabled by default in Squid: $ ceph config set osd bluestore_rocksdb_options_annex 'compression=kLZ4Compression' Restart all OSDs and compact them twice. You can check db_used_bytes before and after enab