[ceph-users] Ceph Steering Committee Team Meeting 2024-10-07

Hi Cephers, The big topic today has been on the *Ceph project Governance*, especifically, *Ceph Steering Committee (CSC) changes *in the context of the ongoing* Ceph Executive Council (CEC) renewal*. Please check this email thread and this e

[ceph-users] Re: About scrub and deep-scrub

Hi Eugen Can you see and give me some advice, number of PG and PG size.. ID CLASS WEIGHTREWEIGHT SIZE RAW USE DATA OMAP META AVAIL%USE VAR PGS STATUS 2hdd 10.98349 1.0 11 TiB 4.5 TiB 4.2 TiB 5.0 MiB 12 GiB 6.5 TiB 40.77 1.00 182 up 17

[ceph-users] About scrub and deep-scrub

Hi ceph users! How about the disable scrub and deep-scrub, i want to disable it because of its effect on many I/O of my cluster. If I disable scrub how will it affect my cluster? If enabled, scrubbing is not complete and takes a long time. Thank Skype: tranphong079 __

[ceph-users] Re: About scrub and deep-scrub

Hi, On 10/7/24 09:27, Phong Tran Thanh wrote: > How about the disable scrub and deep-scrub neither scrubbing nor deep-scrubbing should be disabled, it is an integral part of ensuring data consistency and data availability. if you disable it, ceph will not know when/if data on the disks/ssds has

[ceph-users] Re: About scrub and deep-scrub

Hi, disabling scrubbing in general is bad idea, because you won't notice any data corruption except when it might be too late. But you can fine tune scrubbing, for example increase the interval to allow fewer scrubs to finish in a longer interval. Or if the client load is mainly during busi

[ceph-users] Re: Question about speeding hdd based cluster

Hi, response inline. Zitat von "Kyriazis, George" : Thank you all. The cluster is used mostly for backup of large files currently, but we are hoping to use it for home directories (compiles, etc.) soon. Most usage would be for large files, though. What I've observed with its current us

[ceph-users] Re: About scrub and deep-scrub

So your PGs for pool 52 have a size of around 320 GB, that is quite a lot and not surprising that deep-scrubs take a long time. At the same time, your PGs per OSD are already > 150. We had a similar situation on a customer cluster this year as well, also with 12 TB drives. We decided to inc

[ceph-users] Re: About scrub and deep-scrub

Hi Eugen Adding PG to the cluster only helps to reduce PG size and reduce scrub time is right? >150 PG and <200 in osd i think it's good number My cluster I/O 2-3GB/s real time in 24h IOPS 2K. If choosing to increase PG is it a good choice? Vào Th 2, 7 thg 10, 2024 vào lúc 15:49 Eugen Block đ

[ceph-users] Re: About scrub and deep-scrub

Well, if you have more PGs, the deep-scrubs per PG finish faster, but you have more PGs to scrub. But that way you can stretch the deep-scrub interval. As I said, I can not recommend to increase them in general. Overloading OSDs with too many PGs can have a negative effect as well. If you c

[ceph-users] Re: About scrub and deep-scrub

Yes, I understand. Many thank Eugen Vào Th 2, 7 thg 10, 2024 vào lúc 16:29 Eugen Block đã viết: > Well, if you have more PGs, the deep-scrubs per PG finish faster, but > you have more PGs to scrub. But that way you can stretch the > deep-scrub interval. As I said, I can not recommend to increa

[ceph-users] Re: Membership additions/removals from the Ceph Steering Committee

Hello, The election is live: https://vote.heliosvoting.org/helios/elections/f276a15a-84c5-11ef-a0e4-b69e035002b0/view It was decided that we defer the vote on removals until we: - make the qualifications more clear (e.g. attendance of CSC meetings) - cycle through APAC/EMEA and NA timezone-frien

[ceph-users] Ceph Meetup in Berlin, Germany and Frankfurt/Main, Germany - interested people welcome !

Hi people in Germany, we run two meetup groups in Berlin and Frankfurt with meetings nearly quarterly. For each location, we provide also a quick introduction to Ceph before the main event. Currently, we have a new set of appointments. You can join us by RSVP to the events: - Ceph Frankfurt

[ceph-users] Re: Question about speeding hdd based cluster

> On Oct 7, 2024, at 2:16 AM, Eugen Block wrote: > > Hi, response inline. > > > Zitat von "Kyriazis, George" : > >> Thank you all. >> >> The cluster is used mostly for backup of large files currently, but we are >> hoping to use it for home directories (compiles, etc.) soon. Most usage >

[ceph-users] Question about bucket / object policy

Hello ceph-users, I need to prevent the use of public objects in some Ceph S3 clusters where clients access directly via haproxy as balancer and backend on radosgw. I would like to know if anyone has found a solution to prevent entire Buckets or even single objects from being made accessible wi