Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-12-12 Thread Josef Johansson
Thanks for sharing your solution as well! Happy holidays /Josef On 12 Dec 2015 12:56 pm, "Claes Sahlström" wrote: > Just to share with the rest of the list, my problems have been solved now. > > > > I got this information from Sergey Malinin who had the same problem: > > 1. Stop OSD daemons on a

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-12-12 Thread Claes Sahlström
Just to share with the rest of the list, my problems have been solved now. I got this information from Sergey Malinin who had the same problem: 1. Stop OSD daemons on all nodes. 2. Check the output of "ceph osd tree". You will see some of OSDs showing as "up" - shut them down using "ceph osd do

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-12-07 Thread Claes Sahlström
4388 les/c/f 35775/35859/0 39540/39540/39540) [6] r=-1 lpr=39540 pi=35643-39539/39 crt=29322'12254 lcod 0'0 inactive NOTIFY NIBBLEWISE] clear_recovery_state 2015-12-07 19:05:41.882849 7f925eedf700 20 osd.0 39540 kicking pg 8.ac8 .............. 2015-12-07 19:05:42.041877 7f928a36a700 5 osd.0

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-12-05 Thread Claes Sahlström
52a9700 15 mon.black@0(leader).osd e39530 update_from_paxos paxos e 39531, my e 39530 2015-12-05 19:08:49.894899 7f68852a9700 7 mon.black@0(leader).osd e39530 update_from_paxos applying incremental 39531 2015-12-05 19:08:49.895218 7f68852a9700 1 mon.black@0(leader).osd e39531 e39531: 12 osds: 3 up,

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Claes Sahlström
ceph-users@lists.ceph.com Subject: Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 And if you look through the archives Sage did release a version of Infernalis that fixed if you didn't do it that way as well. On 16 Nov 2015, at 22:15, David Clarke mailto:dav...@

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Josef Johansson
And if you look through the archives Sage did release a version of Infernalis that fixed if you didn’t do it that way as well. > On 16 Nov 2015, at 22:15, David Clarke wrote: > > On 17/11/15 09:46, Claes Sahlström wrote: >> Did some more logging and for some reason it seems like I do have some

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread David Clarke
On 17/11/15 09:46, Claes Sahlström wrote: > Did some more logging and for some reason it seems like I do have some > problem communicating with my OSDs: > > > > “ceph tell osd.* version” gives two different errors that might shed > some light on what is going on… > > > > osd.0: Error ENXIO:

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Josef Johansson
t log entry is > because it cannot check the version of the other OSDs at all. > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com > <mailto:ceph-users-boun...@lists.ceph.com>] On Behalf Of Claes Sahlström > Sent: den 16 november 2015 17:51 > To: 'ceph-users

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Claes Sahlström
Claes Sahlström Sent: den 16 november 2015 17:51 To: 'ceph-users' Subject: Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 After some time 4 more OSD:s from one server dropped out and it now seems that only 3 OSD:s from 1 server (I have 3 servers each with 4 OSD:

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Claes Sahlström
] On Behalf Of Claes Sahlström Sent: den 16 november 2015 15:42 To: Nick Fisk ; 'Josef Johansson' Cc: 'ceph-users' Subject: Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 Tried shutting down my 3 servers and then started them again but I just got

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Claes Sahlström
again… /Claes From: Nick Fisk [mailto:n...@fisk.me.uk] Sent: den 16 november 2015 11:04 To: 'Josef Johansson' ; Claes Sahlström Cc: 'ceph-users' Subject: RE: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 I think I may have experienced something simila

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread Nick Fisk
Subject: Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 cc the list as well On 15 Nov 2015, at 23:41, Josef Johansson mailto:jose...@gmail.com> > wrote: Hi, So it’s just frozen at that point? You should definatly increase the logging and restart the

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-15 Thread Josef Johansson
09.981963 7f6f8f9be940 -1 osd.11 35462 log_to_monitors >> {default=true} >> 2015-11-15 22:59:09.990204 7f6f71312700 0 osd.11 35462 ignoring osdmap >> until we have initialized >> 2015-11-15 22:59:11.194276 7f6f8f9be940 0 osd.11 35462 done with init, >> starting boot

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-15 Thread Josef Johansson
ng > recovery io 22108 MB/s, 5581 objects/s > client io 1065 MB/s rd, 2317 MB/s wr, 11435 op/s > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Claes Sahlström > Sent: den 15 november 2015 21:56 > To: ceph-users@lists.ceph.com > Subject: [ce

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-15 Thread Claes Sahlström
eph-users-boun...@lists.ceph.com] On Behalf Of Claes Sahlström Sent: den 15 november 2015 21:56 To: ceph-users@lists.ceph.com Subject: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04 Hi, I have a problem I hope is possible to solve... I upgraded to 9.2.0 a couple of days back

[ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-15 Thread Claes Sahlström
Hi, I have a problem I hope is possible to solve... I upgraded to 9.2.0 a couple of days back and I missed this part: "If your systems already have a ceph user, upgrading the package will cause problems. We suggest you first remove or rename the existing 'ceph' user and 'ceph' group before upgr