Well, that's no mon crash. On 04/04/2014 06:06 PM, Karol Kozubal wrote:
Anyone know why this happens? What datastore fills up specifically?
The monitor's. Your monitor is sitting on a disk that is filling up. The monitor will check for available disk space to make sure it has enough to work properly without messing things up. It has two different thresholds: one for a warning, set by default at 30%, another for critical, set by default at 5%.
If you hit the 30% avail disk space mark, the mon will output that warning. If you hit the 5% mark, the monitor will shutdown.
Those can be adjusted to saner values depending on your case by setting 'mon data avail warn' and 'mon data avail warn', both expecting integers.
2014-04-04 17:01:51.277954 mon.0 [WRN] reached concerning levels of available space on data store (16% free)
2014-04-04 17:03:51.279801 7ffd0f7fe700 0 monclient: hunting for new mon 2014-04-04 17:03:51.280844 7ffd0d6f9700 0 -- 192.168.0.2:0/1110522 >> 192.168.0.2:6789/0 pipe(0x7ffd04012630 sd=3 :37134 s=1 pgs=0 cs=0 l=1 c=0x7ffd04012890).fault
This means a client was unable to contact a monitor. There may be a several possibilities for this, but in this case it's likely it's the monitor died because you ran out of space on your store? Anyway, you should be able to find the cause for your monitor shutdown on your log file.
-Joao
Any input is appreciated. Karol _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
-- Joao Eduardo Luis Software Engineer | http://inktank.com | http://ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com