Re: [ceph-users] Living with huge bucket sizes

2017-06-13 Thread Eric Choi
Hello all, I work in the same team as Tyler here, and I can provide more info here.. The cluster is indeed an RGW cluster, with many small (100 KB) objects similar to your use case Bryan. But we have the blind bucket set up with "index_type": 1 for this particular bucket, as we wanted to avoid

Re: [ceph-users] Living with huge bucket sizes

2017-06-10 Thread Cullen King
To: Dan van der Ster > Cc: "ceph-users@lists.ceph.com" > Subject: Re: [ceph-users] Living with huge bucket sizes > Message-ID: > gmail.com> > Content-Type: text/plain; charset="UTF-8" > > On Fri, Jun 9, 2017 at 2:21 AM, Dan van der Ster > wr

Re: [ceph-users] Living with huge bucket sizes

2017-06-09 Thread Yehuda Sadeh-Weinraub
On Fri, Jun 9, 2017 at 2:21 AM, Dan van der Ster wrote: > Hi Bryan, > > On Fri, Jun 9, 2017 at 1:55 AM, Bryan Stillwell > wrote: >> This has come up quite a few times before, but since I was only working with >> RBD before I didn't pay too close attention to the conversation. I'm >> looking >>

Re: [ceph-users] Living with huge bucket sizes

2017-06-09 Thread Dan van der Ster
Hi Bryan, On Fri, Jun 9, 2017 at 1:55 AM, Bryan Stillwell wrote: > This has come up quite a few times before, but since I was only working with > RBD before I didn't pay too close attention to the conversation. I'm > looking > for the best way to handle existing clusters that have buckets with a

[ceph-users] Living with huge bucket sizes

2017-06-08 Thread Bryan Stillwell
This has come up quite a few times before, but since I was only working with RBD before I didn't pay too close attention to the conversation. I'm looking for the best way to handle existing clusters that have buckets with a large number of objects (>20 million) in them. The cluster I'm doing test