Re: [ceph-users] v0.94.7 Hammer released

2016-05-24 Thread Dan van der Ster
Hi again, We just finished the upgrade (5 mons, 1200 OSDs). As I mentioned, we had loads of monitor elections and slow requests during the upgrades. perf top showed the leader spending lots of time in LogMonitor::preprocess_log: 43.79% ceph-mon [.] LogMonitor::preprocess_log To m

Re: [ceph-users] v0.94.7 Hammer released

2016-05-24 Thread Dan van der Ster
Hi all, I'm mid-upgrade on a large cluster now. The upgrade is not going smoothly -- it looks like the ceph-mon's are getting bombarded by so many of these crc error warnings that they go into elections. Did anyone upgrade a large cluster from 0.94.6 to 0.94.7 ? If not I'd advise waiting until th

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread Christian Balzer
Hello, for the record, I did the exact same sequence (no MDS) on my test cluster with exactly the same results. Didn't report it as I assumed it to be a more noisy (but harmless) upgrade artifact. Christian On Tue, 17 May 2016 14:07:21 +0200 Dan van der Ster wrote: > On Tue, May 17, 2016 at

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread Dan van der Ster
On Tue, May 17, 2016 at 1:56 PM, Sage Weil wrote: > On Tue, 17 May 2016, Dan van der Ster wrote: >> Hi Sage et al, >> >> I'm updating our pre-prod cluster from 0.94.6 to 0.94.7 and after >> upgrading the ceph-mon's I'm getting loads of warnings like: >> >> 2016-05-17 10:01:29.314785 osd.76 [WRN] f

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread Sage Weil
On Tue, 17 May 2016, Dan van der Ster wrote: > Hi Sage et al, > > I'm updating our pre-prod cluster from 0.94.6 to 0.94.7 and after > upgrading the ceph-mon's I'm getting loads of warnings like: > > 2016-05-17 10:01:29.314785 osd.76 [WRN] failed to encode map e103116 > with expected crc > > I've

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread koukou73gr
Same here. Warnings appeared for OSDs running the .6 version each time one of the rest was restarted to the .7 version. When the last .6 OSD host was upgraded, there where no more warnings from the rest. Cluster seems happy :) -K. On 05/17/2016 11:04 AM, Dan van der Ster wrote: > Hi Sage et a

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread Max A. Krasilnikov
Hello! On Tue, May 17, 2016 at 10:04:41AM +0200, dan wrote: > Hi Sage et al, > I'm updating our pre-prod cluster from 0.94.6 to 0.94.7 and after > upgrading the ceph-mon's I'm getting loads of warnings like: > 2016-05-17 10:01:29.314785 osd.76 [WRN] failed to encode map e103116 > with expected

Re: [ceph-users] v0.94.7 Hammer released

2016-05-17 Thread Dan van der Ster
Hi Sage et al, I'm updating our pre-prod cluster from 0.94.6 to 0.94.7 and after upgrading the ceph-mon's I'm getting loads of warnings like: 2016-05-17 10:01:29.314785 osd.76 [WRN] failed to encode map e103116 with expected crc I've seen that error is whitelisted in the qa-suite: https://github

Re: [ceph-users] v0.94.7 Hammer released

2016-05-16 Thread Dan van der Ster
On Mon, May 16, 2016 at 8:20 AM, Chris Dunlop wrote: > On Fri, May 13, 2016 at 10:21:51AM -0400, Sage Weil wrote: >> This Hammer point release fixes several minor bugs. It also includes a >> backport of an improved ‘ceph osd reweight-by-utilization’ command for >> handling OSDs with higher-than-av

Re: [ceph-users] v0.94.7 Hammer released

2016-05-16 Thread Emmanuel Lacour
Le 16/05/2016 08:20, Chris Dunlop a écrit : > On Fri, May 13, 2016 at 10:21:51AM -0400, Sage Weil wrote: >> This Hammer point release fixes several minor bugs. It also includes a >> backport of an improved ‘ceph osd reweight-by-utilization’ command for >> handling OSDs with higher-than-average ut

Re: [ceph-users] v0.94.7 Hammer released

2016-05-15 Thread Chris Dunlop
On Fri, May 13, 2016 at 10:21:51AM -0400, Sage Weil wrote: > This Hammer point release fixes several minor bugs. It also includes a > backport of an improved ‘ceph osd reweight-by-utilization’ command for > handling OSDs with higher-than-average utilizations. > > We recommend that all hammer v0.