I erased and restart the cluster. But the problem continues. So i tested and discover that the problem was the SSD disks
Em dom, 20 de nov de 2016 às 23:25, Corentin Bonneton <l...@titin.fr> escreveu: > Can you tell me what status your pg is? ceph query given the full results. > > -- > Cordialement, > Corentin BONNETON > > Le 21 nov. 2016 à 03:18, Bruno Silva <bemanuel...@gmail.com> a écrit : > > I killed the structure > > Em dom, 20 de nov de 2016 às 20:37, Corentin Bonneton <l...@titin.fr> > escreveu: > > Hello, > > Please return command : > > ceph pg 0.38 query > > > -- > Cordialement, > Corentin BONNETON > > Le 19 nov. 2016 à 23:54, Bruno Silva <bemanuel...@gmail.com> a écrit : > > I don't know what can i do to solve this. > I try force create pg. > I try deactivate osd. > I add new disks. > And nothing do this scenario change. > > > # ceph health detail > HEALTH_WARN 1 pgs down; 6 pgs incomplete; 6 pgs stuck inactive; 70 pgs > stuck unclean; 7 requests are blocked > 32 sec; 3 osds have slow requests; > recovery 2/574000 objects degraded (0.000%); recovery 4/574000 objects > misplaced (0.001%) > pg 0.3 is stuck inactive since forever, current state incomplete, last > acting [5,4,8] > pg 0.38 is stuck inactive for 292873.404372, current state incomplete, > last acting [1,4,8] > pg 0.43 is stuck inactive for 292705.585643, current state incomplete, > last acting [2,1,4] > pg 0.78 is stuck inactive since forever, current state down+incomplete, > last acting [6,4,3] > pg 0.27 is stuck inactive for 292722.377338, current state incomplete, > last acting [2,7,5] > pg 0.67 is stuck inactive for 292722.377344, current state incomplete, > last acting [2,1,3] > pg 1.23 is stuck unclean for 6418.582518, current state active+remapped, > last acting [8,2] > pg 1.20 is stuck unclean for 6418.713623, current state active+remapped, > last acting [2,5] > pg 1.21 is stuck unclean for 5805.674814, current state active+remapped, > last acting [2,5] > pg 1.1e is stuck unclean for 6418.801677, current state active+remapped, > last acting [8,2] > pg 1.1f is stuck unclean for 6418.973932, current state active+remapped, > last acting [8,2] > pg 1.1c is stuck unclean for 6418.565988, current state active+remapped, > last acting [8,2] > pg 1.1d is stuck unclean for 5805.686500, current state active+remapped, > last acting [8,2] > pg 1.1a is stuck unclean for 6418.860193, current state active+remapped, > last acting [2,4] > pg 1.1b is stuck unclean for 5805.510934, current state active+remapped, > last acting [2,3] > pg 1.18 is stuck unclean for 5805.667627, current state active+remapped, > last acting [2,4] > pg 1.19 is stuck unclean for 6418.358465, current state active+remapped, > last acting [8,2] > pg 0.78 is stuck unclean since forever, current state down+incomplete, > last acting [6,4,3] > pg 1.16 is stuck unclean for 6418.850241, current state active+remapped, > last acting [2,4] > pg 1.17 is stuck unclean for 5805.511008, current state active+remapped, > last acting [8,2] > pg 1.14 is stuck unclean for 6418.566994, current state active+remapped, > last acting [2,1] > pg 1.15 is stuck unclean for 6418.195558, current state active+remapped, > last acting [8,2] > pg 1.12 is stuck unclean for 5805.669319, current state active+remapped, > last acting [2,7] > pg 1.13 is stuck unclean for 5805.679161, current state active+remapped, > last acting [2,1] > pg 1.10 is stuck unclean for 5805.675267, current state active+remapped, > last acting [2,5] > pg 1.11 is stuck unclean for 5805.679200, current state active+remapped, > last acting [2,1] > pg 1.e is stuck unclean for 5805.669306, current state active+remapped, > last acting [2,1] > pg 1.f is stuck unclean for 5805.669406, current state active+remapped, > last acting [2,4] > pg 1.c is stuck unclean for 5805.679299, current state active+remapped, > last acting [8,2] > pg 1.d is stuck unclean for 5805.669460, current state active+remapped, > last acting [2,6] > pg 1.a is stuck unclean for 6418.329215, current state active+remapped, > last acting [2,3] > pg 1.b is stuck unclean for 6418.561476, current state active+remapped, > last acting [2,1] > pg 1.8 is stuck unclean for 6418.406537, current state active+remapped, > last acting [2,4] > pg 1.9 is stuck unclean for 5805.669603, current state active+remapped, > last acting [8,2] > pg 1.6 is stuck unclean for 6418.273455, current state active+remapped, > last acting [2,1] > pg 0.67 is stuck unclean for 293107.340137, current state incomplete, last > acting [2,1,3] > pg 1.7 is stuck unclean for 5805.669690, current state active+remapped, > last acting [8,2] > pg 1.4 is stuck unclean for 6418.446173, current state active+remapped, > last acting [2,3] > pg 1.5 is stuck unclean for 6418.375788, current state active+remapped, > last acting [2,1] > pg 1.2 is stuck unclean for 5805.683492, current state active+remapped, > last acting [2,1] > pg 0.3 is stuck unclean since forever, current state incomplete, last > acting [5,4,8] > pg 1.3 is stuck unclean for 6418.463264, current state active+remapped, > last acting [8,2] > pg 1.0 is stuck unclean for 5805.683303, current state active+remapped, > last acting [8,2] > pg 1.1 is stuck unclean for 5805.506588, current state active+remapped, > last acting [2,3] > pg 0.43 is stuck unclean for 292705.586031, current state incomplete, last > acting [2,1,4] > pg 1.3e is stuck unclean for 6418.317627, current state active+remapped, > last acting [2,1] > pg 1.3f is stuck unclean for 6418.724621, current state active+remapped, > last acting [2,4] > pg 1.3c is stuck unclean for 6418.664822, current state active+remapped, > last acting [2,1] > pg 1.3d is stuck unclean for 5805.676951, current state active+remapped, > last acting [2,5] > pg 1.3a is stuck unclean for 5805.497688, current state active+remapped, > last acting [2,4] > pg 1.3b is stuck unclean for 5805.677027, current state active+remapped, > last acting [8,2] > pg 1.38 is stuck unclean for 5805.497725, current state active+remapped, > last acting [8,2] > pg 0.38 is stuck unclean for 292873.404814, current state incomplete, last > acting [1,4,8] > pg 1.39 is stuck unclean for 6418.680542, current state active+remapped, > last acting [2,4] > pg 1.36 is stuck unclean for 5805.677083, current state active+remapped, > last acting [2,5] > pg 1.37 is stuck unclean for 6418.309163, current state active+remapped, > last acting [8,2] > pg 1.34 is stuck unclean for 5805.508778, current state active+remapped, > last acting [2,3] > pg 1.35 is stuck unclean for 5805.508841, current state active+remapped, > last acting [2,3] > pg 1.32 is stuck unclean for 6418.555610, current state active+remapped, > last acting [8,2] > pg 1.33 is stuck unclean for 5805.508928, current state active+remapped, > last acting [2,3] > pg 1.30 is stuck unclean for 5805.684678, current state active+remapped, > last acting [2,1] > pg 1.31 is stuck unclean for 6418.526243, current state active+remapped, > last acting [2,3] > pg 1.2e is stuck unclean for 6418.692727, current state active+remapped, > last acting [8,2] > pg 1.2f is stuck unclean for 5805.677361, current state active+remapped, > last acting [8,2] > pg 1.2c is stuck unclean for 5805.671127, current state active+remapped, > last acting [2,7] > pg 1.2d is stuck unclean for 5805.671193, current state active+remapped, > last acting [2,6] > pg 1.2a is stuck unclean for 6418.576690, current state active+remapped, > last acting [2,3] > pg 1.2b is stuck unclean for 6418.566350, current state active+remapped, > last acting [8,2] > pg 1.28 is stuck unclean for 5805.671315, current state active+remapped, > last acting [2,1] > pg 1.29 is stuck unclean for 6418.571029, current state active+remapped, > last acting [2,3] > pg 1.26 is stuck unclean for 6418.560121, current state active+remapped, > last acting [2,1] > pg 0.27 is stuck unclean for 293107.340347, current state incomplete, last > acting [2,7,5] > pg 1.27 is stuck unclean for 6418.887716, current state active+remapped, > last acting [2,4] > pg 1.24 is stuck unclean for 6418.565877, current state active+remapped, > last acting [8,2] > pg 1.25 is stuck unclean for 5805.686565, current state active+remapped, > last acting [2,1] > pg 1.22 is stuck unclean for 5805.675053, current state active+remapped, > last acting [2,5] > pg 0.27 is incomplete, acting [2,7,5] > pg 0.3 is incomplete, acting [5,4,8] > pg 0.78 is down+incomplete, acting [6,4,3] > pg 0.67 is incomplete, acting [2,1,3] > pg 0.43 is incomplete, acting [2,1,4] > pg 0.38 is incomplete, acting [1,4,8] > 4 ops are blocked > 16777.2 sec > 3 ops are blocked > 8388.61 sec > 1 ops are blocked > 16777.2 sec on osd.1 > 2 ops are blocked > 8388.61 sec on osd.1 > 3 ops are blocked > 16777.2 sec on osd.2 > 1 ops are blocked > 8388.61 sec on osd.5 > 3 osds have slow requests > recovery 2/574000 objects degraded (0.000%) > recovery 4/574000 objects misplaced (0.001%) > root@pmx00node04:~# ceph osd tree > ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY > -9 4.00000 root ssd > 8 4.00000 osd.8 up 1.00000 1.00000 > -1 3.96997 root default > -3 1.09000 host pmx00node03 > 1 0.53999 osd.1 up 1.00000 1.00000 > 5 0.54999 osd.5 up 1.00000 1.00000 > -5 0.73999 host pmx00node04 > 2 0.53000 osd.2 up 1.00000 1.00000 > 8 0.20999 osd.8 up 1.00000 1.00000 > -6 1.07999 host pmx00node01 > 6 0.53999 osd.6 up 1.00000 1.00000 > 7 0.53999 osd.7 up 1.00000 1.00000 > -7 0.53000 host pmx00node02 > 3 0.53000 osd.3 up 1.00000 1.00000 > -8 0.53000 host pmx00node05 > 4 0.53000 osd.4 up 1.00000 1.00000 > 0 0 osd.0 down 0 1.00000 > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
