> It's important to disable the rbd cache on tgtd host. Set in 
> /etc/ceph/ceph.conf: 


Should this be done on the iscsi target server? I have a default option to 
enable rbd caching as it speeds things up on the vms. 

Thanks 

Andrei 




----- Original Message -----

From: "Vlad Gorbunov" <vadi...@gmail.com> 
To: "Sergey Malinin" <h...@newmail.com> 
Cc: "Andrei Mikhailovsky" <and...@arhont.com>, ceph-users@lists.ceph.com 
Sent: Wednesday, 7 May, 2014 2:23:52 PM 
Subject: Re: [ceph-users] NFS over CEPH - best practice 


It's easy to install tgtd with ceph support. ubuntu 12.04 for example: 
Connect ceph-extras repo: 
echo deb http://ceph.com/packages/ceph-extras/debian $(lsb_release -sc) main | 
sudo tee /etc/apt/sources.list.d/ceph-extras.list 


Install tgtd with rbd support: 
apt-get update 
apt-get install tgt 

It's important to disable the rbd cache on tgtd host. Set in 
/etc/ceph/ceph.conf: 
[client] 
rbd_cache = false 

Define permanent export rbd with iscsi in /etc/tgt/targets.conf: 

<target iqn.2014-04.rbdstore.example.com:volume512> 
driver iscsi 
bs-type rbd 
backing-store iscsi/volume512 
initiator-address 10.166.18.87 
</target 


service tgt reload 

Or use commands: 

tgtadm --lld iscsi --mode logicalunit --op new --tid 1 --lun 1 --backing-store 
iscsi/volume512 --bstype rbd 

tgtadm -C 0 --lld iscsi --op bind --mode target --tid 1 -I 10.166.18.87 
tgt-admin -s 
show current iscsi settings and sessions. 




You can install tgtd on multiple osd/monitor hosts and connect iscsi initiator 
to this servers with multipath enabled. Iscsi proxy servers not needed with 
tgtd.  

On Thu, May 8, 2014 at 12:20 AM, Sergey Malinin< h...@newmail.com >, wrote: 



http://www.hastexo.com/resources/hints-and-kinks/turning-ceph-rbd-images-san-storage-devices
 

On Wednesday, May 7, 2014 at 15:06, Andrei Mikhailovsky wrote: 
<blockquote>





Vlad, is there a howto somewhere describing the steps on how to setup iscsi 
multipathing over ceph? It looks like a good alternative to nfs 

Thanks 



From: "Vlad Gorbunov" < vadi...@gmail.com > 
To: "Andrei Mikhailovsky" < and...@arhont.com > 
Cc: ceph-users@lists.ceph.com 
Sent: Wednesday, 7 May, 2014 12:02:09 PM 
Subject: Re: [ceph-users] NFS over CEPH - best practice 

For XenServer or VMware is better to use iscsi client to tgtd with ceph 
support. You can install tgtd on osd or monitor server and use multipath for 
failover. 



On Wed, May 7, 2014 at 9:47 PM, Andrei Mikhailovsky < and...@arhont.com > 
wrote: 

<blockquote>

Hello guys, 

I would like to offer NFS service to the XenServer and VMWare hypervisors for 
storing vm images. I am currently running ceph rbd with kvm, which is working 
reasonably well. 

What would be the best way of running NFS services over CEPH, so that the 
XenServer and VMWare's vm disk images are stored in ceph storage over NFS? 

Many thanks 

Andrei 






_______________________________________________ 
ceph-users mailing list 
ceph-users@lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
</blockquote>



</blockquote>

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to