Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-31 Thread Sage Weil
On Mon, 31 Mar 2014, Jens Kristian Søgaard wrote: > Hi, > > > Perhaps as a workaround you should just wipe this mon's data dir and > > remake it? > > That's a possibility ofcourse! > > I really would like to know if there's something to gain from using > leveldb from ceph-extras instead of the d

Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-31 Thread Jens Kristian Søgaard
Hi, Perhaps as a workaround you should just wipe this mon's data dir and remake it? That's a possibility ofcourse! I really would like to know if there's something to gain from using leveldb from ceph-extras instead of the distribution? -- Jens Kristian Søgaard, Mermaid Consulting ApS, j...@

Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-31 Thread Dan Van Der Ster
Sent: 31 March 2014 20:55 To: Gregory Farnum Cc: ceph-users Subject: Re: [ceph-users] Mon hangs when started after Emperor upgrade Hi Gregory, > Is the mon process doing anything (that is, does it have any CPU > usage)? This looks to be an internal leveldb issue, but not one that > we&

Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-31 Thread Jens Kristian Søgaard
Hi Gregory, Is the mon process doing anything (that is, does it have any CPU usage)? This looks to be an internal leveldb issue, but not one that we've run into before, so I think there must be something unique about the leveldb store involved. No, it is not doing anything at all. I'm not sur

Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-31 Thread Gregory Farnum
Is the mon process doing anything (that is, does it have any CPU usage)? This looks to be an internal leveldb issue, but not one that we've run into before, so I think there must be something unique about the leveldb store involved. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com

Re: [ceph-users] Mon hangs when started after Emperor upgrade

2014-03-30 Thread Jens Kristian Søgaard
Hi again, Next I tried restarting a mon - but it won't start up again. It just just hangs: I have captured a backtrace of the hang using gdb: (gdb) bt #0 0x773e6e4d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x773e2cc1 in _L_lock_885 () from /lib64/libpthread.so.0

[ceph-users] Mon hangs when started after Emperor upgrade

2014-03-30 Thread Jens Kristian Søgaard
Hi guys, I upgraded a working cluster from Dumpling to Emperor which went OK. All mons, osds and mds running 0.72.2 on Fedora 18 now. I then installed the ceph-extras repo and let it update curl, libcurl and leveldb. Next I tried restarting a mon - but it won't start up again. It just just