Re: [ceph-users] Slow requests during ceph osd boot

2015-08-07 Thread Jan Schermer
You'd need to disable the udev rule as well as the initscript (probably somewhere in /lib/udev/) What I do when I'm restarting the server is: chmod -x /usr/bin/ceph-osd Jan > On 07 Aug 2015, at 05:11, Nathan O'Sullivan wrote: > > I'm seeing the same sort of issue. > > Any suggestions on how

Re: [ceph-users] Slow requests during ceph osd boot

2015-08-06 Thread Nathan O'Sullivan
I'm seeing the same sort of issue. Any suggestions on how to get Ceph to not start the ceph-osd processes on host boot? It does not seem to be as simple as just disabling the service Regards Nathan On 15/07/2015 7:15 PM, Jan Schermer wrote: We have the same problems, we need to start the

Re: [ceph-users] Slow requests during ceph osd boot

2015-07-17 Thread Kostis Fardelas
Thanks for your answers, we will also experiment with osd recovery max active / threads and will come back to you Regards, Kostis On 16 July 2015 at 12:29, Jan Schermer wrote: > For me setting recovery_delay_start helps during the OSD bootup _sometimes_, > but it clearly does something differen

Re: [ceph-users] Slow requests during ceph osd boot

2015-07-16 Thread Jan Schermer
For me setting recovery_delay_start helps during the OSD bootup _sometimes_, but it clearly does something different than what’s in the docs. Docs say: After peering completes, Ceph will delay for the specified number of seconds before starting to recover objects. However, what I see is greatl

Re: [ceph-users] Slow requests during ceph osd boot

2015-07-15 Thread Andrey Korolyov
On Wed, Jul 15, 2015 at 12:15 PM, Jan Schermer wrote: > We have the same problems, we need to start the OSDs slowly. > The problem seems to be CPU congestion. A booting OSD will use all available > CPU power you give it, and if it doesn’t have enough nasty stuff happens > (this might actually be

Re: [ceph-users] Slow requests during ceph osd boot

2015-07-15 Thread Jan Schermer
We have the same problems, we need to start the OSDs slowly. The problem seems to be CPU congestion. A booting OSD will use all available CPU power you give it, and if it doesn’t have enough nasty stuff happens (this might actually be the manifestation of some kind of problem in our setup as wel

Re: [ceph-users] Slow requests during ceph osd boot

2015-07-15 Thread Kostis Fardelas
Hello, after some trial and error we concluded that if we start the 6 stopped OSD daemons with a delay of 1 minute, we do not experience slow requests (threshold is set on 30 sec), althrough there are some ops that last up to 10s which is already high enough. I assume that if we spread the delay mo

[ceph-users] Slow requests during ceph osd boot

2015-07-13 Thread Kostis Fardelas
Hello, after rebooting a ceph node and the OSDs starting booting and joining the cluster, we experience slow requests that get resolved immediately after cluster recovers. It is improtant to note that before the node reboot, we set noout flag in order to prevent recovery - so there are only degrade