[ceph-users] OSDMap problem: osd does not exist.

Hi, recently I tried to upgrade from 0.57 to 0.67.3, hit the changes of mon protocol, and so I updated all of the 5 mons. After upgrading the mon, (and during the debugging of other problems,) I removed and created the mon filesystem from scratch. OSDMap and Crushmap seems to be blown by this; I

Re: [ceph-users] OSDMap problem: osd does not exist.

On 09/12/2013 09:35 AM, Yasuhiro Ohara wrote: Hi, recently I tried to upgrade from 0.57 to 0.67.3, hit the changes of mon protocol, and so I updated all of the 5 mons. After upgrading the mon, (and during the debugging of other problems,) I removed and created the mon filesystem from scratch.

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

Hi Yehuda I run a similar setup like Hugo Radosgw is on a dedicated host, no OSD's on the gw. There is no socket on my radosgw either apart from unix 2 [ ACC ] STREAM LISTENING 10029/tmp/radosgw.sock I changed PG's of .rgw, .rgw.bucket to 1000 Added rgw cache enabled = fa

Re: [ceph-users] CephFS no longer mounts and asserts in MDS after upgrade to 0.67.3

Hey Gregory, On wo, 2013-09-11 at 11:36 -0700, Gregory Farnum wrote: > On Wed, Sep 11, 2013 at 7:48 AM, Yan, Zheng wrote: > > On Wed, Sep 11, 2013 at 10:06 PM, Oliver Daudey wrote: > >> Hey Yan, > >> > >> On 11-09-13 15:12, Yan, Zheng wrote: > >>> On Wed, Sep 11, 2013 at 7:51 PM, Oliver Daudey

[ceph-users] live migration with rbd/cinder/nova - not supported?

Hi, It seems that the combination of libvirt and ceph will happily do live migrations. However, when using openstack, and a nova instance is booted from a cinder volume that itself exists in rbd, it appears from the nova code that nova itself does not have support for instance migration due to th

Re: [ceph-users] live migration with rbd/cinder/nova - not supported?

Hi I dont know which version of openstack you are using but I ensure you that everything works fine with Grizzly. Let me know if you need some help. regards -- Maciej Gałkiewicz Shelly Cloud Sp. z o. o., Sysadmin http://shellycloud.com/, mac...@shellycloud.com KRS: 440358 REGON: 101504426 _

Re: [ceph-users] live migration with rbd/cinder/nova - not supported?

Hi Maciej, I'm using Grizzly, but the live migration doesn't appear to be changed even in trunk. It seems to check if you are using shared storage by writing a test file on the destination host (in /var/lib/nova/instances) and then trying to read it on the source host, and will fail if this test

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Thu, Sep 12, 2013 at 4:11 AM, Fuchs, Andreas (SwissTXT) wrote: > Hi Yehuda > > I run a similar setup like Hugo > > Radosgw is on a dedicated host, no OSD's on the gw. There is no socket on my > radosgw either apart from > unix 2 [ ACC ] STREAM LISTENING 10029/tmp/radosgw.

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

I'm confusing now. Sounds like that radosgw-admin is a daemon or service ? Is there any document for study ? I set admin_socket in ceph.conf and restart radosgw daemon. But there still has no asock of radosgw tho. My ceph.conf looks like : [global] fsid = 6e05675c-f545-4d88-9784-ea56ceda750e

Re: [ceph-users] OSDMap problem: osd does not exist.

Hi Joao, Thank you for the response. I meant "ceph-mon -i X --mkfs". Actually I did it on 3 node. On other 2 mon nodes, the original mon data were left, but currently all 5 nodes run ceph-mon again. That I shouldn't do that ? regards, Yasu From: Joao Eduardo Luis Subject: Re: [ceph-users] OSD

Re: [ceph-users] live migration with rbd/cinder/nova - not supported?

Hi Maciej, That's interesting. The following also seems to suggest that nova has those shared storage dependencies for live migration that I spoke about: http://tracker.ceph.com/issues/5938 Thanks Darren On 12 September 2013 17:01, Maciej Gałkiewicz wrote: > On 12 September 2013 15:15, Darre

[ceph-users] Unable to create account on tracker.ceph.com

On Tuesday I tried to create an account at tracker.ceph.com so I can start filing bugs, but the process never completed. The form said "sending confirmation email to your address" or something like that, but the email never came. If I try the "lost password" form, it tells me "Invalid user or pas

Re: [ceph-users] Hit suicide timeout on osd start

To be more precise, not only debug_ms was changed from 0 to 1, debug_osd was also changed from 0 to 50. Seems like a race condition somewhere under the hood, that had been concealed by logging delays and was revealed only after excluding those delays (by setting debug ms/osd to 0). 2013/9/12 Andr

Re: [ceph-users] xfsprogs not found in RHEL

That worked. Thank you. I have followed the steps on this wiki (which needs update. I will summarize the changes at the end) - http://ceph.com/docs/master/install/rpm/ I do not find any file call fastcgi.conf which is specified as shown below in the link. Any ideas? 1. Turn off fastcgiwrap

Re: [ceph-users] CephFS no longer mounts and asserts in MDS after upgrade to 0.67.3

Hey Yan, On 12-09-13 03:58, Yan, Zheng wrote: > On Thu, Sep 12, 2013 at 3:26 AM, Oliver Daudey > wrote: >> Hey Yan, >> >> Just confirming that creating fresh pools and doing the newfs on those >> fixed the problem, while restarting the OSDs didn't, thanks again! If >> yo

Re: [ceph-users] xfsprogs not found in RHEL

Adding to the previous issue. I dont see any files specified in 1,2 and 3 below. I dont have fastcgi.conf, ceph.conf or s3gw.fcgi. I have followed everything up till that point in the wiki. Is there anything missing in the wiki or should I create them? 1. Turn off fastcgiwrapper in /etc/h

Re: [ceph-users] Hit suicide timeout on osd start

A little follow-up: One of cluster nodes(from not-yet-restarted set) went in some kind of flapping state exposing cpu consumption peaks and latency spikes every 50 seconds. Even more interesting thing was that when we injected non-zero debug_ms latency spikes had gone away, but cpu ones remains as

Re: [ceph-users] live migration with rbd/cinder/nova - not supported?

On 12 September 2013 15:15, Darren Birkett wrote: > Hi Maciej, > > I'm using Grizzly, but the live migration doesn't appear to be changed even > in trunk. It seems to check if you are using shared storage by writing a > test file on the destination host (in /var/lib/nova/instances) and then > try

Re: [ceph-users] live migration with rbd/cinder/nova - not supported?

On 09/12/2013 11:33 AM, Darren Birkett wrote: Hi Maciej, That's interesting. The following also seems to suggest that nova has those shared storage dependencies for live migration that I spoke about: http://tracker.ceph.com/issues/5938 That's obsolete for Grizzly. True live migration works f

Re: [ceph-users] Issue with Ceph setup

[added ceph-users] On Thu, 12 Sep 2013, Abhay Sachan wrote: > Hi Mr. Weil, > I am trying to create a cluster using ceph-deploy utility. I have tried > version 1.2.2 and 1.2.3, but both the versions fail with the following error > during monitor creation: > > [tea][DEBUG ] deploying mon to tea

[ceph-users] Launching #ceph-devel

Greetings and salutations! We have been blessed with an abundance of Ceph-related discussion on IRC and as a result have decided to split off those discussions which are strictly related to the development of Ceph to a new Channel. Enter #ceph-devel (still on OFTC): http://ceph.com/resources/mail

Re: [ceph-users] [Ceph] 10Gb network support

What command did you use to get those results? Have you tried increasing parallelism? What bandwidth do you have between that machine and your OSDs? Have you run lower-level tests on individual disks and nodes to make sure they're performing as you expect? -Greg Software Engineer #42 @ http://inkta

[ceph-users] many report failed after mon election

Hi, Today i have some issues with ceph cluster. After new mon election many osd has been marked failed. Some time later osd boot and i think recover because meny slow request appear. Cluster come back after about 20minutes. cluster: ceph version 0.56.6 6 servers x 26 osd 2013-09-12 07:11:40.92038

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Thu, Sep 12, 2013 at 7:32 AM, Kuo Hugo wrote: > I'm confusing now. > > Sounds like that radosgw-admin is a daemon or service ? > Is there any document for study ? > > > I set admin_socket in ceph.conf and restart radosgw daemon. But there still > has no asock of radosgw tho. > > My ceph.conf l

Re: [ceph-users] ocfs2 for OSDs?

Previous experience with OCFS2 was that its actual performance was pretty lackluster/awful. The bits Oracle threw on top of (I think) ext3 to make it work as a multi-writer filesystem with all of the signalling that implies brought the overall performance down. Jeff On Wed, Sep 11, 2013 at 9:58

Re: [ceph-users] many report failed after mon election

On Thu, 12 Sep 2013, Dominik Mostowiec wrote: > Hi, > Today i have some issues with ceph cluster. > After new mon election many osd has been marked failed. > Some time later osd boot and i think recover because meny slow request appear. > Cluster come back after about 20minutes. Was there some oth

[ceph-users] About ceph unit test and function test code coverage

Hello, I am new to ceph. We are planning to use ceph. Before we actually start to work on it, we would like to know ceph's both unit test and function test code coverage. Could you please share us both results? That would be very helpful to us. Thanks a lot! -- Regards, Zhi

Re: [ceph-users] About ceph unit test and function test code coverage

Hi David, You can run the unit tests from sources and get coverage as explained in http://dachary.org/?p=1781 The majority of code coverage is done via the integration tests run by teuthology. You can setup teuthology as described here : http://dachary.org/?p=2204 Note however that, to the bes