What you need is tgtd and this patch from the ceph site http://ceph.com/dev-notes/updates-to-ceph-tgt-iscsi-support/ for tgt-admin, then you can set up udev rules for persistent naming on the initiator and in turn set up multipathd – the caveat here is that we’ve never had any luck getting more than 20-40MBps over iscsi with ceph, mapping directly with rbd we can saturate a gigabit link so it looks like an issue with tgt underperforming. Please let us know if you manage to get better speeds, we are interested in using ceph more for backend storage for vms but at the moment are mostly only using it internally, settling for booting over iscsi and then using rbd within vms to map devices for high performance workspace inside the vps.
Regards, Maciej Bonin Systems Engineer | M247 Limited M247.com Connected with our Customers Contact us today to discuss your hosting and connectivity requirements ISO 27001 | ISO 9001 | Deloitte Technology Fast 50 | Deloitte Technology Fast 500 EMEA | Sunday Times Tech Track 100 M247 Ltd, registered in England & Wales #4968341. 1 Ball Green, Cobra Court, Manchester, M32 0QT ISO 27001 Data Protection Classification: A - Public From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Andrei Mikhailovsky Sent: 09 May 2014 12:38 To: l...@consolejunkie.net Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] NFS over CEPH - best practice Ideally I would like to have a setup with 2+ iscsi servers, so that I can perform maintenance if necessary without shutting down the vms running on the servers. I guess multipathing is what I need. Also I will need to have more than one xenserver/vmware host servers, so the iscsi LUNs will be mounted on several servers. Would the suggested setup not work for my requirements? Andrei ________________________________________ From: "Leen Besselink" <l...@consolejunkie.net> To: ceph-users@lists.ceph.com Sent: Thursday, 8 May, 2014 9:35:21 PM Subject: Re: [ceph-users] NFS over CEPH - best practice On Thu, May 08, 2014 at 01:24:17AM +0200, Gilles Mocellin wrote: > Le 07/05/2014 15:23, Vlad Gorbunov a écrit : > >It's easy to install tgtd with ceph support. ubuntu 12.04 for example: > > > >Connect ceph-extras repo: > >echo deb http://ceph.com/packages/ceph-extras/debian $(lsb_release > >-sc) main | sudo tee /etc/apt/sources.list.d/ceph-extras.list > > > >Install tgtd with rbd support: > >apt-get update > >apt-get install tgt > > > >It's important to disable the rbd cache on tgtd host. Set in > >/etc/ceph/ceph.conf: > >[client] > >rbd_cache = false > [...] > > Hello, > Hi, > Without cache on the tgtd side, it should be possible to have > failover and load balancing (active/avtive) multipathing. > Have you tested multipath load balancing in this scenario ? > > If it's reliable, it opens a new way for me to do HA storage with iSCSI ! > I have a question, what is your use case ? Do you need SCSI-3 persistent reservations so multiple machines can use the same LUN at the same time ? Because in that case I think tgtd won't help you. Have a good day, Leen. _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
