[ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
Hi everyone, we see at our cluster relatively slow Single Thread Performance on the iscsi Nodes. Our setup: 3 Racks: 18x Data Nodes, 3 Mon Nodes, 3 iscsi Gateway Nodes with tgt (rbd cache off). 2x Samsung SM863 Enterprise SSD for Journal (3 OSD per SSD) and 6x WD Red 1TB per Data Node as

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
lists.ceph.com] On Behalf Of Horace Sent: 21 July 2016 10:26 To: w...@globe.de Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Hi, Same here, I've read some blog saying that vmware will frequently verify the locking on VMFS over iSCSI, hence i

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
...@lists.ceph.com] On Behalf Of w...@globe.de Sent: 21 July 2016 13:04 To: n...@fisk.me.uk; 'Horace Ng' Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Hi, hmm i think 200 MByte/s is really bad. Is your Cluster in production right now? It&#

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
Is there not a way to enable Linux page Cache? So do not user D_Sync... Then we would the dramatically performance improve. Am 21.07.16 um 14:33 schrieb Nick Fisk: -Original Message- From: w...@globe.de [mailto:w...@globe.de] Sent: 21 July 2016 13:23 To: n...@fisk.me.uk; 'Hora

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
rados bench... *rados bench -p rbd 60 write -b 4M -t 1* Am 21.07.16 um 14:38 schrieb w...@globe.de: Is there not a way to enable Linux page Cache? So do not user D_Sync... Then we would the dramatically performance improve. Am 21.07.16 um 14:33 schrieb Nick Fisk: -Original Message-

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
would need 10 threads to be able to write to 10 nodes at the same time. Jake On Thursday, July 21, 2016, w...@globe.de <mailto:w...@globe.de> mailto:w...@globe.de>> wrote: What i not really undertand is: Lets say the Intel P3700 works with 200 MByte/s rados bench on

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
. You get exactly the same problems with reading when you don’t set the readahead above 4MB. *From:*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf Of *w...@globe.de *Sent:* 21 July 2016 14:05 *To:* ceph-users@lists.ceph.com *Subject:* Re: [ceph-users] Ceph + VMware + Single

[ceph-users] Ubuntu 14.04 Striping / RBD / Single Thread Performance

2016-08-03 Thread w...@globe.de
Hi List, i am using Ceph Infernalis and Ubuntu 14.04 Kernel 3.13. 18 Data Server / 3 MON / 3 RBD Clients I want to use RBD on the Client with image format 2 and Striping. Is it supported? I want to create rbd with: rbd create testrbd -s 2T --image-format=2 --image-feature=striping --image-featu