> Shard...66? Really, that's what it says? Can you copy a few lines of the > output?
Just posting the last few lines to give a good Impression of the missing-object-situation: 96 ceph-osd: 2014-06-16 10:45:20.300894 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing babdf7f1/10000212b52.00000165/head//0 96 ceph-osd: 2014-06-16 10:45:20.300897 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing babdf7f1/10000212b52.00000165/head//0 96 ceph-osd: 2014-06-16 10:45:20.300901 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing 5acdf7f1/100001dc324.0000130c/head//0 96 ceph-osd: 2014-06-16 10:45:20.300904 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing 5acdf7f1/100001dc324.0000130c/head//0 96 ceph-osd: 2014-06-16 10:45:20.300908 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing b42ef7f1/100001204c7.00000000/head//0 96 ceph-osd: 2014-06-16 10:45:20.300911 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing b42ef7f1/100001204c7.00000000/head//0 96 ceph-osd: 2014-06-16 10:45:20.300915 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing 1f4ef7f1/1000017fd3c.00000a1d/head//0 96 ceph-osd: 2014-06-16 10:45:20.300918 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing 1f4ef7f1/1000017fd3c.00000a1d/head//0 96 ceph-osd: 2014-06-16 10:45:20.300921 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing dd9ef7f1/100001021d0.0000000f/head//0 96 ceph-osd: 2014-06-16 10:45:20.300925 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing dd9ef7f1/100001021d0.0000000f/head//0 96 ceph-osd: 2014-06-16 10:45:20.300928 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing 801ff7f1/100001fa418.000022f0/head//0 96 ceph-osd: 2014-06-16 10:45:20.300931 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing 801ff7f1/100001fa418.000022f0/head//0 96 ceph-osd: 2014-06-16 10:45:20.300934 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing 3a5ff7f1/100002254e8.0000212d/head//0 96 ceph-osd: 2014-06-16 10:45:20.300942 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing 3a5ff7f1/100002254e8.0000212d/head//0 96 ceph-osd: 2014-06-16 10:45:20.300945 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing deaff7f1/10000213cae.00001924/head//0 96 ceph-osd: 2014-06-16 10:45:20.300949 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing deaff7f1/10000213cae.00001924/head//0 96 ceph-osd: 2014-06-16 10:45:20.300952 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 1 missing 9fdff7f1/100001fa418.000014ed/head//0 96 ceph-osd: 2014-06-16 10:45:20.300956 7f7c73ff7700 0 log [ERR] : 0.7f1 shard 66 missing 9fdff7f1/100001fa418.000014ed/head//0 96 ceph-osd: 2014-06-16 10:45:20.302293 7f7c73ff7700 0 log [ERR] : 0.7f1 deep-scrub 809 missing, 0 inconsistent objects 96 ceph-osd: 2014-06-16 10:45:20.302301 7f7c73ff7700 0 log [ERR] : 0.7f1 deep-scrub 1618 errors > This may be tangling up some of the other issues you're seeing, but it > looks like you didn't preserve xattrs (at least on the directory). Ah, thanks! Missed the “-X” option with rsync. >> And wouldn't it be relatively easy to >> implement an option to "pg repair" to choose a backup OSD as source >> instead of the primary OSD? >Umm, maybe. Tickets welcome! okay, i made a new one for this: http://tracker.ceph.com/issues/8609 _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com