Re: [ceph-users] Experiences with Ceph at the June'14 issue of USENIX ; login:

2014-06-04 Thread Christian Balzer
Hello Filippos, On Wed, 4 Jun 2014 17:22:35 +0300 Filippos Giannakos wrote: > Hello Ian, > > Thanks for your interest. > > On Mon, Jun 02, 2014 at 06:37:48PM -0400, Ian Colle wrote: > > Thanks, Filippos! Very interesting reading. > > > > Are you comfortable enough yet to remove the RAID-1 fro

[ceph-users] Storage

2014-06-04 Thread yalla.gnan.kumar
Hi All, I have a ceph storage cluster with four nodes. I have created block storage using cinder in openstack and ceph as its storage backend. So, I see a volume is created in ceph in one of the pools. But how to get information like on which OSD, PG, the volume is created in ? Thanks Kumar

[ceph-users] osd down/out problem

2014-06-04 Thread Cao, Buddy
Hi, some of the osds in my env continues to try to connect to monitors/ceph nodes, but get connection refused and down/out. It even worse when I try to initialize 100+ osds (800G HDD for each osd), most of the osds would run into the same problem to connect to monitor. I checked the monitor sta

Re: [ceph-users] rados benchmark is fast, but dd result on guest vm still slow?

2014-06-04 Thread Christian Balzer
Hello, On Wed, 4 Jun 2014 23:46:33 +0800 Indra Pramana wrote: > Hi Christian, > > In addition to my previous email, I realised that if I use dd with 4M > block size, I can get higher speed. > > root@Ubuntu-12043-64bit:/data# dd bs=4M count=128 if=/dev/zero of=test4 > conv=fdatasync oflag=direc

Re: [ceph-users] rados benchmark is fast, but dd result on guest vm still slow?

2014-06-04 Thread Christian Balzer
Hello, On Wed, 4 Jun 2014 22:36:00 +0800 Indra Pramana wrote: > Hi Christian, > > Good day to you, and thank you for your reply. > > Just now I managed to identify 3 more OSDs which were slow and needed to > be trimmed. Here is a longer (1 minute) result of rados bench after the > trimming: >

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Dan Van Der Ster
On 04 Jun 2014, at 16:06, Sage Weil wrote: > You can adjust this on running OSDs with something like 'ceph daemon > osd.NN config set osd_snap_trim_sleep .01' or with 'ceph tell osd.* > injectargs -- --osd-snap-trim-sleep .01'. Thanks, trying that now. I noticed that using = 0.01 in ceph.conf

Re: [ceph-users] RGW: Multi Part upload and resulting objects

2014-06-04 Thread Yehuda Sadeh
On Wed, Jun 4, 2014 at 8:49 AM, Gregory Farnum wrote: > On Wed, Jun 4, 2014 at 7:58 AM, Sylvain Munaut > wrote: >> Hi, >> >> >> During a multi part upload you can't upload parts smaller than 5M, and >> radosgw also slices object in slices of 4M. Having those two being >> different is a bit unfort

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Andrey Korolyov
On 06/04/2014 07:22 PM, Sage Weil wrote: > On Wed, 4 Jun 2014, Andrey Korolyov wrote: >> On 06/04/2014 06:06 PM, Sage Weil wrote: >>> On Wed, 4 Jun 2014, Dan Van Der Ster wrote: Hi Sage, all, On 21 May 2014, at 22:02, Sage Weil wrote: > * osd: allow snap trim throttling wit

Re: [ceph-users] RGW: Multi Part upload and resulting objects

2014-06-04 Thread Gregory Farnum
On Wed, Jun 4, 2014 at 7:58 AM, Sylvain Munaut wrote: > Hi, > > > During a multi part upload you can't upload parts smaller than 5M, and > radosgw also slices object in slices of 4M. Having those two being > different is a bit unfortunate because if you slice your files in the > minimum chunk size

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Andrey Korolyov
On 06/04/2014 06:06 PM, Sage Weil wrote: > On Wed, 4 Jun 2014, Dan Van Der Ster wrote: >> Hi Sage, all, >> >> On 21 May 2014, at 22:02, Sage Weil wrote: >> >>> * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) >> >> Do you have some advice about how to use the snap trim thrott

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Sage Weil
On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > On 04 Jun 2014, at 16:06, Sage Weil wrote: > > > You can adjust this on running OSDs with something like 'ceph daemon > > osd.NN config set osd_snap_trim_sleep .01' or with 'ceph tell osd.* > > injectargs -- --osd-snap-trim-sleep .01'. > > Thanks,

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Sage Weil
On Wed, 4 Jun 2014, Andrey Korolyov wrote: > On 06/04/2014 07:22 PM, Sage Weil wrote: > > On Wed, 4 Jun 2014, Andrey Korolyov wrote: > >> On 06/04/2014 06:06 PM, Sage Weil wrote: > >>> On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > Hi Sage, all, > > On 21 May 2014, at 22:02, Sage Weil

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Sage Weil
On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > On 04 Jun 2014, at 16:06, Sage Weil wrote: > > > On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > >> Hi Sage, all, > >> > >> On 21 May 2014, at 22:02, Sage Weil wrote: > >> > >>> * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) >

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Sage Weil
On Wed, 4 Jun 2014, Andrey Korolyov wrote: > On 06/04/2014 06:06 PM, Sage Weil wrote: > > On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > >> Hi Sage, all, > >> > >> On 21 May 2014, at 22:02, Sage Weil wrote: > >> > >>> * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) > >> > >>

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Dan Van Der Ster
On 04 Jun 2014, at 16:06, Sage Weil wrote: > On Wed, 4 Jun 2014, Dan Van Der Ster wrote: >> Hi Sage, all, >> >> On 21 May 2014, at 22:02, Sage Weil wrote: >> >>> * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) >> >> Do you have some advice about how to use the snap trim

[ceph-users] RGW: Multi Part upload and resulting objects

2014-06-04 Thread Sylvain Munaut
Hi, During a multi part upload you can't upload parts smaller than 5M, and radosgw also slices object in slices of 4M. Having those two being different is a bit unfortunate because if you slice your files in the minimum chunk size you end up with a main file of 4M and a shadowfile of 1M for each

Re: [ceph-users] Experiences with Ceph at the June'14 issue of USENIX ; login:

2014-06-04 Thread Filippos Giannakos
Hello Ian, Thanks for your interest. On Mon, Jun 02, 2014 at 06:37:48PM -0400, Ian Colle wrote: > Thanks, Filippos! Very interesting reading. > > Are you comfortable enough yet to remove the RAID-1 from your architecture and > get all that space back? Actually, we are not ready to do that yet.

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Sage Weil
On Wed, 4 Jun 2014, Dan Van Der Ster wrote: > Hi Sage, all, > > On 21 May 2014, at 22:02, Sage Weil wrote: > > > * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) > > Do you have some advice about how to use the snap trim throttle? I saw > osd_snap_trim_sleep, which is sti

Re: [ceph-users] Storage

2014-06-04 Thread Mārtiņš Jakubovičs
Hello, How can check ceph client session in clients side, for example, when mount iscsi or nfs, you can check it (nfs just mount, iscsi iscsiadm -m session), but how can do that with ceph? And is there more detailed documentation about openstack and ceph than http://ceph.com/docs/master/rbd/rbd-op

Re: [ceph-users] OSD server alternatives to choose

2014-06-04 Thread Cedric Lemarchand
Le 04/06/2014 03:23, Christian Balzer a écrit : > On Tue, 03 Jun 2014 18:52:00 +0200 Cedric Lemarchand wrote: >> Le 03/06/2014 12:14, Christian Balzer a écrit : >>> A simple way to make 1) and 2) cheaper is to use AMD CPUs, they will do >>> just fine at half the price with these loads. >>> If you

Re: [ceph-users] Storage

2014-06-04 Thread Smart Weblications GmbH - Florian Wiessner
Hi, Am 04.06.2014 14:51, schrieb yalla.gnan.ku...@accenture.com: > Hi All, > > > > I have a ceph storage cluster with four nodes. I have created block storage > using cinder in openstack and ceph as its storage backend. > > So, I see a volume is created in ceph in one of the pools. But how

[ceph-users] Storage

2014-06-04 Thread yalla.gnan.kumar
Hi All, I have a ceph storage cluster with four nodes. I have created block storage using cinder in openstack and ceph as its storage backend. So, I see a volume is created in ceph in one of the pools. But how to get information like on which OSD, PG, the volume is created in ? Thanks Kumar

Re: [ceph-users] v0.67.9 Dumpling released

2014-06-04 Thread Dan Van Der Ster
Hi Sage, all, On 21 May 2014, at 22:02, Sage Weil wrote: > * osd: allow snap trim throttling with simple delay (#6278, Sage Weil) Do you have some advice about how to use the snap trim throttle? I saw osd_snap_trim_sleep, which is still 0 by default. But I didn't manage to follow the original