I'm operating a fairly small ceph cluster, currently three nodes (with
plans to expand to five in the next couple of months) with more than
adequate hardware. Node specs:
2x Xeon E5-2630
64gb ram
2x RAID1 SSD for system
2x 256gb SSDs for journals
4x 4tb drives for OSDs
1GbE for frontend (shared wi
Gregory Farnum wrote:
> On Tue, May 12, 2015 at 12:03 PM, Cullen King
> wrote:
> > I'm operating a fairly small ceph cluster, currently three nodes (with
> plans
> > to expand to five in the next couple of months) with more than adequate
> > hardware. Node specs:
> &
Bryan, I just went through this myself, also on Hammer, as offline bucket
index resharding was backported. I had three buckets with > 10 million
objects each, one of them with 30 million. I was experiencing the typical
blocked request issue during scrubs, when the placement group containing
the buc
Hello,
I've been trying to nail down a nasty performance issue related to
scrubbing. I am mostly using radosgw with a handful of buckets containing
millions of various sized objects. When ceph scrubs, both regular and deep,
radosgw blocks on external requests, and my cluster has a bunch of request
Replies in-line:
On Wed, Feb 3, 2016 at 9:54 PM, Christian Balzer
wrote:
>
> Hello,
>
> On Wed, 3 Feb 2016 17:48:02 -0800 Cullen King wrote:
>
> > Hello,
> >
> > I've been trying to nail down a nasty performance issue related to
> > scrubbing. I am mo
ot;,
> ---
> > "objecter_inflight_ops": "10240",
> 506c506
> < "osd_op_threads": "4",
> ---
> > "osd_op_threads": "20",
> 510c510
> < "osd_disk_threads": "4",
> ---
> >
ounds painful!
On Thu, Feb 4, 2016 at 7:56 PM, Christian Balzer wrote:
>
> Hello,
>
> On Thu, 4 Feb 2016 08:44:25 -0800 Cullen King wrote:
>
> > Replies in-line:
> >
> > On Wed, Feb 3, 2016 at 9:54 PM, Christian Balzer
> > wrote:
> >
> > >
>
On Wed, Feb 17, 2016 at 12:13 AM, Christian Balzer wrote:
>
> Hello,
>
> On Tue, 16 Feb 2016 10:46:32 -0800 Cullen King wrote:
>
> > Thanks for the helpful commentary Christian. Cluster is performing much
> > better with 50% more spindles (12 to 18 drives), along with
