You need to either change failure domain to osd or need at least 5 host to satisfy host failure domain. Since it is not satisfying failure domain , pgs are undersized and degraded..
Thanks & Regards Somnath From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Khang Nguy?n Nh?t Sent: Wednesday, June 01, 2016 9:33 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] Ceph Pool JERASURE issue. Hi, I have 1 cluster as pictured below: [cid:image001.png@01D1BC4D.B9ED37D0] - OSD-host1 run 2 ceph-osd daemon is mounted in /var/ceph/osd0 and /var/ceph/osd1. - OSD-host2 run 2 ceph-osd daemon is mounted in /var/ceph/osd2 and /var/ceph/osd3. - OSD-host3 only run 1 ceph-osd daemon is mounted in the /var/ceph/osd4. - This is my myprofile: jerasure-per-chunk-alignment = false k = 3 m = 2 plugin = jerasure ruleset-failure-domain = host ruleset-root = default technique = reed_sol_van w = 8 When I used it to create a pool CLI: ceph osd create test pool myprofile 8 8 erasure. (id test pool=62) CLI: ceph-s Here are the results /// health HEALTH_WARN 8 pgs degraded 8 pgs stuck unclean 8 pgs undersized monmap e1: 1 mons at {mon0 = x.x.x.x: 6789/0} election epoch 7, quorum 0 mon0 osdmap e441: 5 osds: 5 up, 5 in flags sortbitwise pgmap /// 8 Active + undersized + degraded CLI: health CePH detail HEALTH_WARN 8 pgs degraded; 8 pgs stuck unclean; 8 pgs undersized 62.6 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [1,2,2147483647,2147483647,4] 62.7 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [2,0,2147483647,4,2147483647] 62.4 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [3,0,4,2147483647,2147483647] 62.5 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [0,4,2147483647,3,2147483647] 62.2 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [1,2147483647,2147483647,4,2] 62.3 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [2,2147483647,0,4,2147483647] 62.0 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [0,3,2147483647,4,2147483647] 62.1 pg is stuck unclean since forever, current degraded state active + + undersized, last acting [4,0,3,2147483647,2147483647] is active + 62.1 pg undersized + degraded, acting [4,0,3,2147483647,2147483647] is active + 62.0 pg undersized + degraded, acting [0,3,2147483647,4,2147483647] is active + 62.3 pg undersized + degraded, acting [2,2147483647,0,4,2147483647] is active + 62.2 pg undersized + degraded, acting [1,2147483647,2147483647,4,2] is active + 62.5 pg undersized + degraded, acting [0,4,2147483647,3,2147483647] is active + 62.4 pg undersized + degraded, acting [3,0,4,2147483647,2147483647] is active + 62.7 pg undersized + degraded, acting [2,0,2147483647,4,2147483647] is active + 62.6 pg undersized + degraded, acting [1,2,2147483647,2147483647,4] This is related to reasonable ruleset-failure-domain? Can somebody please help me out ? Thank ! PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com