Re: [ceph-users] High load during recovery (after disk placement)

2015-11-25 Thread Mart van Santen
On 11/23/2015 07:19 PM, Gregory Farnum wrote: > On Fri, Nov 20, 2015 at 11:33 AM, Simon Engelsman wrote: >> [cut] > In addition to what Robert said, it sounds like you've done something > strange with your CRUSH map. Do you have separate trees for the SSDs > and hard drives, or are they both und

Re: [ceph-users] High load during recovery (after disk placement)

2015-11-23 Thread Gregory Farnum
On Fri, Nov 20, 2015 at 11:33 AM, Simon Engelsman wrote: > Hi, > > We've experienced a very weird problem last week with our Ceph > cluster. We would like to ask your opinion(s) and advice > > Our dedicated Ceph OSD nodes run with: > > Total platform > - IO Average: 2500 wrps, ~ 600 rps > - Replic

Re: [ceph-users] High load during recovery (after disk placement)

2015-11-20 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 We are seeing some of these issues as well, here is some things we have learned. We found in our testing that enabling DISCARD as a mount option on the SSD OSDs did not measurably affect performance (be sure to test on your SSDs to be sure though).

[ceph-users] High load during recovery (after disk placement)

2015-11-20 Thread Simon Engelsman
Hi, We've experienced a very weird problem last week with our Ceph cluster. We would like to ask your opinion(s) and advice Our dedicated Ceph OSD nodes run with: Total platform - IO Average: 2500 wrps, ~ 600 rps - Replica's: 3x 2 pools: - SSD (~50x1TB) - Spinner (~36x2TB) - 1024 PG's per pool