[ceph-users] Erasure pool performance expectations

2016-05-02 Thread Peter Kerdisle
Hi guys, I am currently testing the performance of RBD using a cache pool and a 4/2 erasure profile pool. I have two SSD cache servers (2 SSDs for journals, 7 SSDs for data) with 2x10Gbit bonded each and a six OSD nodes with a 10Gbit public and 10Gbit cluster network for the erasure pool (10x3TB

Re: [ceph-users] Erasure pool performance expectations

2016-05-03 Thread Peter Kerdisle
Hey Nick, Thanks for taking the time to answer my questions. Some in-line comments. On Tue, May 3, 2016 at 10:51 AM, Nick Fisk wrote: > Hi Peter, > > > > -Original Message- > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > > Pete

Re: [ceph-users] Erasure pool performance expectations

2016-05-03 Thread Peter Kerdisle
Thank you, I will attempt to play around with these settings and see if I can achieve better read performance. Appreciate your insights. Peter On Tue, May 3, 2016 at 3:00 PM, Nick Fisk wrote: > > > > -Original Message- > > From: Peter Kerdisle [mailto:peter.

[ceph-users] Diagnosing slow requests

2016-05-05 Thread Peter Kerdisle
Hey guys, I'm running into an issue with my cluster during high activity. I have two SSD cache servers (2 SSDs for journals, 7 SSDs for data) with 2x10Gbit bonded each and a six OSD nodes with a 10Gbit public and 10Gbit cluster network for the erasure pool (10x3TB without separate journal). This

Re: [ceph-users] Erasure pool performance expectations

2016-05-06 Thread Peter Kerdisle
Hey Mark, Sorry I missed your message as I'm only subscribed to daily digests. > Date: Tue, 3 May 2016 09:05:02 -0500 > From: Mark Nelson > To: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Erasure pool performance expectations > Message-ID: > Content-Type: text/plain; charset=windows-

Re: [ceph-users] Erasure pool performance expectations

2016-05-08 Thread Peter Kerdisle
cluster? Thanks, Peter On Fri, May 6, 2016 at 9:58 AM, Peter Kerdisle wrote: > Hey Mark, > > Sorry I missed your message as I'm only subscribed to daily digests. > > >> Date: Tue, 3 May 2016 09:05:02 -0500 >> From: Mark Nelson >> To: ceph-users@lists.ceph.co

Re: [ceph-users] Erasure pool performance expectations

2016-05-10 Thread Peter Kerdisle
this setting. Is there an other way to change these settings? On Sun, May 8, 2016 at 2:37 PM, Peter Kerdisle wrote: > Hey guys, > > I noticed the merge request that fixes the switch around here > https://github.com/ceph/ceph/pull/8912 > > I had two questions: > > >-

Re: [ceph-users] Erasure pool performance expectations

2016-05-10 Thread Peter Kerdisle
.ceph.com] On Behalf Of > > Peter Kerdisle > > Sent: 10 May 2016 14:37 > > Cc: ceph-users@lists.ceph.com > > Subject: Re: [ceph-users] Erasure pool performance expectations > > > > To answer my own question it seems that you can change setting

Re: [ceph-users] Erasure pool performance expectations

2016-05-11 Thread Peter Kerdisle
m the cluster to see what happens then. Thanks for all your help so far! On Wed, May 11, 2016 at 9:07 AM, Nick Fisk wrote: > Hi Peter, yes just restart the OSD for the setting to take effect. > > > > *From:* ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf > Of

Re: [ceph-users] Erasure pool performance expectations

2016-05-15 Thread Peter Kerdisle
-users-boun...@lists.ceph.com] On Behalf Of > > Peter Kerdisle > > Sent: 10 May 2016 14:37 > > Cc: ceph-users@lists.ceph.com > > Subject: Re: [ceph-users] Erasure pool performance expectations > > > > To answer my own question it seems that you can chan

Re: [ceph-users] Erasure pool performance expectations

2016-05-16 Thread Peter Kerdisle
http://docs.ceph.com/docs/master/rados/operations/cache-tiering/ On Mon, May 16, 2016 at 11:14 AM Nick Fisk wrote: > > -Original Message- > > From: Peter Kerdisle [mailto:peter.kerdi...@gmail.com] > > Sent: 15 May 2016 08:04 > > To: Nick Fisk > > Cc: ceph-use

Re: [ceph-users] Erasure pool performance expectations

2016-05-16 Thread Peter Kerdisle
On Mon, May 16, 2016 at 11:58 AM, Nick Fisk wrote: > > -Original Message- > > From: Peter Kerdisle [mailto:peter.kerdi...@gmail.com] > > Sent: 16 May 2016 10:39 > > To: n...@fisk.me.uk > > Cc: ceph-users@lists.ceph.com > > Subject: Re: [ceph-users] E

Re: [ceph-users] Erasure pool performance expectations

2016-05-16 Thread Peter Kerdisle
Thanks yet again Nick for the help and explanations. I will experiment some more and see if I can get the slow requests further down and increase the overall performance. On Mon, May 16, 2016 at 12:20 PM, Nick Fisk wrote: > > > > -Original Message- > > Fr

Re: [ceph-users] Erasure pool performance expectations

2016-05-16 Thread Peter Kerdisle
On Mon, May 16, 2016 at 12:20 PM, Nick Fisk wrote: > > > > -Original Message- > > From: Peter Kerdisle [mailto:peter.kerdi...@gmail.com] > > Sent: 16 May 2016 11:04 > > To: Nick Fisk > > Cc: ceph-users@lists.ceph.com > > Subject: Re: [ceph-us

Re: [ceph-users] Diagnosing slow requests

2016-05-23 Thread Peter Kerdisle
ot being able to fix this and I simply don't know what else I can do at this point. If anybody has anything I haven't tried before please let me know. Peter On Thu, May 5, 2016 at 10:30 AM, Peter Kerdisle wrote: > Hey guys, > > I'm running into an issue with my cluster du

Re: [ceph-users] Diagnosing slow requests

2016-05-23 Thread Peter Kerdisle
25 AM, Christian Balzer wrote: > > Hello, > > On Mon, 23 May 2016 10:45:41 +0200 Peter Kerdisle wrote: > > > Hey, > > > > Sadly I'm still battling this issue. I did notice one interesting thing. > > > > I changed the cache settings for my cache t

[ceph-users] heartbeat_check failures

2016-06-20 Thread Peter Kerdisle
Hey guys, Today I noticed when adding new monitors to the cluster that two OSD servers couldn't talk to each other for some reason. I am not sure if adding the monitors caused this issue or whether the issue was always there but adding the monitor showed it. After removing the new monitor the clus