I had the exact same error when using --bypass-gc. We too decided to
destroy this realm and start it fresh. For us, 95% of the data in this
realm is backups for other systems and they're find rebuilding it. So our
plan is to migrate the 5% of the data to a temporary s3 location and then
rebuild
On Wed, Oct 25, 2017 at 4:02 PM, Yehuda Sadeh-Weinraub
wrote:
>
> On Wed, Oct 25, 2017 at 2:32 PM, Bryan Stillwell
> wrote:
> > That helps a little bit, but overall the process would take years at this
> > rate:
> >
> > # for i in {1..3600}; do ceph df -f json-pretty |grep -A7 '".rgw.buckets"'
8 0.49
>
> 418 0.2 1.0 181G 61353M 121G 33.06 0.47
>
> 419 0.2 1.0 181G 77168M 105G 41.58 0.59
>
>
>
> That's ~560G of omap data for the .rgw.gc pool that isn't being reported in
> 'ceph df'.
>
>
>
> Right now the clust
ryan
From: Yehuda Sadeh-Weinraub
Date: Wednesday, October 25, 2017 at 11:32 AM
To: Bryan Stillwell
Cc: David Turner , Ben Hines ,
"ceph-users@lists.ceph.com"
Subject: Re: [ceph-users] Speeding up garbage collection in RGW
Some of the options there won't do much for you as they&#x
ed up the gc process, we should be able to do that.
>
> Bryan
>
> From: ceph-users on behalf of David
> Turner
> Date: Tuesday, October 24, 2017 at 4:07 PM
> To: Ben Hines
> Cc: "ceph-users@lists.ceph.com"
> Subject: Re: [ceph-users] Speeding up garbage collec
: ceph-users on behalf of David Turner
Date: Tuesday, October 24, 2017 at 4:07 PM
To: Ben Hines
Cc: "ceph-users@lists.ceph.com"
Subject: Re: [ceph-users] Speeding up garbage collection in RGW
Thank you so much for chiming in, Ben.
Can you explain what each setting value means? I be
from this bucket.
>>> I've come across a few references to the rgw-gc settings in the config, but
>>> nothing that explained the times well enough for me to feel comfortable
>>> doing anything with them.
>>>
>>> On Tue, Jul 25, 2017 at 4:01 PM Bry
ng anything
>> with them.
>>
>> On Tue, Jul 25, 2017 at 4:01 PM Bryan Stillwell
>> wrote:
>>
>>> Excellent, thank you! It does exist in 0.94.10! :)
>>>
>>>
>>>
>>> Bryan
>>>
>>>
>>>
>>> *F
doing anything
> with them.
>
> On Tue, Jul 25, 2017 at 4:01 PM Bryan Stillwell
> wrote:
>
>> Excellent, thank you! It does exist in 0.94.10! :)
>>
>>
>>
>> Bryan
>>
>>
>>
>> *From: *Pavan Rallabhandi
>> *Date: *Tuesday, July 25, 2017
cellent, thank you! It does exist in 0.94.10! :)
>
>
>
> Bryan
>
>
>
> *From: *Pavan Rallabhandi
> *Date: *Tuesday, July 25, 2017 at 11:21 AM
>
>
> *To: *Bryan Stillwell , "ceph-users@lists.ceph.com"
>
> *Subject: *Re: [ceph-users] Speeding up ga
Excellent, thank you! It does exist in 0.94.10! :)
Bryan
From: Pavan Rallabhandi
Date: Tuesday, July 25, 2017 at 11:21 AM
To: Bryan Stillwell , "ceph-users@lists.ceph.com"
Subject: Re: [ceph-users] Speeding up garbage collection in RGW
I’ve just realized that the option is
I’ve just realized that the option is present in Hammer (0.94.10) as well, you
should try that.
From: Bryan Stillwell
Date: Tuesday, 25 July 2017 at 9:45 PM
To: Pavan Rallabhandi ,
"ceph-users@lists.ceph.com"
Subject: EXT: Re: [ceph-users] Speeding up garbage collection in RGW
Unf
nable amount of time.
Thanks,
Bryan
From: Pavan Rallabhandi
Date: Tuesday, July 25, 2017 at 3:00 AM
To: Bryan Stillwell , "ceph-users@lists.ceph.com"
Subject: Re: [ceph-users] Speeding up garbage collection in RGW
If your Ceph version is >=Jewel, you can try the `--bypass-gc` opti
If your Ceph version is >=Jewel, you can try the `--bypass-gc` option in
radosgw-admin, which would remove the tails objects as well without marking
them to be GCed.
Thanks,
On 25/07/17, 1:34 AM, "ceph-users on behalf of Bryan Stillwell"
wrote:
I'm in the process of cleaning up a test th
M
> To: Bryan Stillwell , "ceph-users@lists.ceph.com"
>
> Subject: Re: [ceph-users] Speeding up garbage collection in RGW
>
> I hope someone else can answer your question better, but in my case I found
> something like this helpful to delete objects faster than I could th
Wouldn't doing it that way cause problems since references to the objects
wouldn't be getting removed from .rgw.buckets.index?
Bryan
From: Roger Brown
Date: Monday, July 24, 2017 at 2:43 PM
To: Bryan Stillwell , "ceph-users@lists.ceph.com"
Subject: Re: [ceph-users]
I hope someone else can answer your question better, but in my case I found
something like this helpful to delete objects faster than I could through
the gateway:
rados -p default.rgw.buckets.data ls | grep 'replace this with pattern
matching files you want to delete' | xargs -d '\n' -n 200 rados
17 matches
Mail list logo
