Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread Mark Kirkwood
Interesting - I had tried that on the RBD volumes only (via blockdev --setra, but I think the effect is the same as tweaking read_ahead_kb directly), however it made no difference. Unfortunately I didn't think to adjust on the OSD's too - I'll try it out. One thing that seemed to make a big

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread McNamara, Bradley
@lists.ceph.com Subject: Re: [ceph-users] Live database files on Ceph On 03/04/2014 23:43, Brian Beverage wrote: > Here is some info on what I am trying to accomplish. My goal here is > to find the least expensive way to get into Virtualization and storage > without the cost of a SAN and Pr

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread Mark Nelson
One thing you can try is tuning read_ahead_kb on the OSDs and/or the RBD volume(s) and see if that helps. On some hardware we've seen this improve sequential read performance dramatically. Another big culprit that can really hurt sequential reads is fragmentation. BTRFS is particularly bad w

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread Martin B Nielsen
Hi, We're running mysql in multi-master cluster (galera), mysql standalones, postgresql, mssql and oracle db's on ceph RBD via QEMU/KVM. As someone else pointed out it is usually faster with ceph, but sometimes you'll get some odd slow reads. Latency is our biggest enemy. Oracle comes with an aw

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread John-Paul Robinson
I've seen this "fast everything except sequential reads" asymmetry in my own simple dd tests on RBD images but haven't really understood the cause. Could you clarify what's going on that would cause that kind of asymmetry. I've been assuming that once I get around to turning on/tuning read caching

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread Mark Kirkwood
As others have mentioned, there is no reason you cannot run databases on Ceph storage. I've been running/testing Postgres and Mysql/Mariadb on Ceph RDB volumes for quite a while now - since version 0.50 (typically inside KVM containers but via the kernel driver will work too). With a reasonabl

Re: [ceph-users] Live database files on Ceph

2014-04-04 Thread Brian Candler
On 03/04/2014 23:43, Brian Beverage wrote: Here is some info on what I am trying to accomplish. My goal here is to find the least expensive way to get into Virtualization and storage without the cost of a SAN and Proprietary software ... I have been tasked with taking a new start up project and

Re: [ceph-users] Live database files on Ceph

2014-04-03 Thread Brian Beverage
Thanks for the replies. Here is some info on what I am trying to accomplish. My goal here is to find the least expensive way to get into Virtualization and storage without the cost of a SAN and Proprietary software(eg Vmware, Hyper-V). We currently run about 6 servers that host our web based appli

Re: [ceph-users] Live database files on Ceph

2014-04-03 Thread Mark Nelson
Back last fall I ran the DBT3 TPC-H test suite using mariadb on top of a QEMU/KVM RBD volume (dumpling release) on a virtual machine. I intentionally kept the cache sizes small to force more disk IO and compared to the same test running on a local disk passed through to the VM as well. In th

Re: [ceph-users] Live database files on Ceph

2014-04-03 Thread Gregory Farnum
Ceph will allow anything; it's just providing a block device. How it performs will depend quite a lot on the database workload you're applying, though. We've heard from people who think it's wonderful and others who don't, depending on what hardware they're using and what their use case is. You'll

[ceph-users] Live database files on Ceph

2014-04-03 Thread Brian Beverage
I am looking at setting up a Ganeti cluster using KVM and CentOS. While looking at storage I first looked at Gluster but noticed in the documentation it does not allow Live Database files to be saved to it. Does Ceph allow the use of LIVE database files being saved to it. If so does the database pe