Re: [ceph-users] CephFS+NFS For VMWare

2018-07-02 Thread David C
o:paul.emmer...@croit.io] > *Sent:* 29 June 2018 17:57 > *To:* Nick Fisk > *Cc:* ceph-users > *Subject:* Re: [ceph-users] CephFS+NFS For VMWare > > > > VMWare can be quite picky about NFS servers. > > Some things that you should test before deploying anything with tha

Re: [ceph-users] CephFS+NFS For VMWare

2018-07-02 Thread Maged Mokhtar
Hi Nick, With iSCSI we reach over 150 MB/s vmotion for single vm, 1 GB/s for 7-8 vm migrations. Since these are 64KB block sizes, latency/iops is a large factor, you need either controllers with write back cache or all flash . hdds without write cache will suffer even with external wal/db on ssds

Re: [ceph-users] CephFS+NFS For VMWare

2018-07-02 Thread Paul Emmerich
. > > > > I was planning on Kernel CephFS and NFS server, both seem to achieve > better performance, although stability is of greater concern. > > > > Thanks, > > Nick > > *From:* Paul Emmerich [mailto:paul.emmer...@croit.io] > *Sent:* 29 June 2018 17:57

Re: [ceph-users] CephFS+NFS For VMWare

2018-07-02 Thread Nick Fisk
Quoting Ilya Dryomov : On Fri, Jun 29, 2018 at 8:08 PM Nick Fisk wrote: This is for us peeps using Ceph with VMWare. My current favoured solution for consuming Ceph in VMWare is via RBD’s formatted with XFS and exported via NFS to ESXi. This seems to perform better than iSCSI+VMFS whi

Re: [ceph-users] CephFS+NFS For VMWare

2018-07-02 Thread Ilya Dryomov
On Fri, Jun 29, 2018 at 8:08 PM Nick Fisk wrote: > > This is for us peeps using Ceph with VMWare. > > > > My current favoured solution for consuming Ceph in VMWare is via RBD’s > formatted with XFS and exported via NFS to ESXi. This seems to perform better > than iSCSI+VMFS which seems to not pl

Re: [ceph-users] CephFS+NFS For VMWare

2018-06-30 Thread Nick Fisk
greater concern. Thanks, Nick From: Paul Emmerich [mailto:paul.emmer...@croit.io] Sent: 29 June 2018 17:57 To: Nick Fisk Cc: ceph-users Subject: Re: [ceph-users] CephFS+NFS For VMWare VMWare can be quite picky about NFS servers. Some things that you should test before deploying

Re: [ceph-users] CephFS+NFS For VMWare

2018-06-29 Thread Paul Emmerich
VMWare can be quite picky about NFS servers. Some things that you should test before deploying anything with that in production: * failover * reconnects after NFS reboots or outages * NFS3 vs NFS4 * Kernel NFS (which kernel version? cephfs-fuse or cephfs-kernel?) vs NFS Ganesha (VFS FSAL vs. Ceph

[ceph-users] CephFS+NFS For VMWare

2018-06-29 Thread Nick Fisk
This is for us peeps using Ceph with VMWare. My current favoured solution for consuming Ceph in VMWare is via RBD's formatted with XFS and exported via NFS to ESXi. This seems to perform better than iSCSI+VMFS which seems to not play nicely with Ceph's PG contention issues particularly if wor