Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-10 Thread Kyle Bader
It's hard to comment on how your experience could be made better without more information about your configuration and how your testing. Anything along the lines of what LSI controller model, PCI-E bus speed, number of expander cables, drive type, number of SSDs and whether the SSDs were connected

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-09 Thread Warren Wang
While in theory this should be true, I'm not finding it to be the case for a typical enterprise LSI card with 24 drives attached. We tried a variety of ratios and went back to collocated journals on the spinning drives. Eagerly awaiting the tiered performance changes to implement a faster tier

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-09 Thread Kyle Bader
Journal on SSD should effectively double your throughput because data will not be written to the same device twice to ensure transactional integrity. Additionally, by placing the OSD journal on an SSD you should see less latency, the disk head no longer has to seek back and forth between the journa

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-08 Thread Robert van Leeuwen
> I tried putting Flashcache on my spindle OSDs using an Intel SSL and it works > great. > This is getting me read and write SSD caching instead of just write > performance on the journal. > It should also allow me to protect the OSD journal on the same drive as the > OSD data and still get bene

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-07 Thread Jason Villalta
I tried putting Flashcache on my spindle OSDs using an Intel SSL and it works great. This is getting me read and write SSD caching instead of just write performance on the journal. It should also allow me to protect the OSD journal on the same drive as the OSD data and still get benefits of SSD c

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-07 Thread Jason Villalta
I found this without much effort. http://www.sebastien-han.fr/blog/2012/11/15/make-your-rbd-fly-with-flashcache/ On Mon, Oct 7, 2013 at 11:39 AM, Jason Villalta wrote: > I also would be interested in how bcache or flashcache would integrate. > > > On Mon, Oct 7, 2013 at 11:34 AM, Martin Catudal

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-07 Thread Jason Villalta
I also would be interested in how bcache or flashcache would integrate. On Mon, Oct 7, 2013 at 11:34 AM, Martin Catudal wrote: > Thank's Mike, > Kyle Bader suggest me also to use my large SSD (900 GB) as cache > drive using "bcache" or "flashcache". > Since I have already plan to use SSD f

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-07 Thread Martin Catudal
Thank's Mike, Kyle Bader suggest me also to use my large SSD (900 GB) as cache drive using "bcache" or "flashcache". Since I have already plan to use SSD for my journal, I would certainly use also SSD as cache drive in addition. I will have to read documentation about "bcache" and his integ

Re: [ceph-users] About Ceph SSD and HDD strategy

2013-10-07 Thread Mike Lowe
Based on my experience I think you are grossly underestimating the expense and frequency of flushes issued from your vm's. This will be especially bad if you aren't using the async flush from qemu >= 1.4.2 as the vm is suspended while qemu waits for the flush to finish. I think your best cours

[ceph-users] About Ceph SSD and HDD strategy

2013-10-06 Thread Martin Catudal
Hi Guys, I read all Ceph documentation more than twice. I'm now very comfortable with all the aspect of Ceph except for the strategy of using my SSD and HDD. Here is my reflexion I've two approach in my understanding about use fast SSD (900 GB) for my primary storage and huge but slower H