This is an odd one. My cluster is reporting an inconsistent pg in ceph status and ceph health detail. However, rados list-inconsistent-obj and rados list-inconsistent-snapset both report no inconsistencies. Scrubbing the pg results in these errors in the osd logs:
OSD 63 (primary): 2017-08-21 12:41:03.580068 7f0b36629700 -1 bluestore(/var/lib/ceph/osd/ceph-63) _verify_csum bad crc32c/0x1000 checksum at blob offset 0x0, got 0x6b6b9184, expected 0x6706be76, device location [0x23f39d0000~1000], logical extent 0x0~1000, object #9:55bf7cc6:::rbd_data.33992ae8944a.000000000000200f:e# 2017-08-21 12:41:03.961945 7f0b36629700 -1 log_channel(cluster) log [ERR] : 9.aa soid 9:55bf7cc6:::rbd_data.33992ae8944a.000000000000200f:e: failed to pick suitable object info 2017-08-21 12:41:15.357484 7f0b36629700 -1 log_channel(cluster) log [ERR] : 9.aa deep-scrub 3 errors OSD 50: 2017-08-21 12:41:03.592918 7f264be6d700 -1 bluestore(/var/lib/ceph/osd/ceph-50) _verify_csum bad crc32c/0x1000 checksum at blob offset 0x0, got 0x64a1e2b1, expected 0x6706be76, device location [0x3418830000~1000], logical extent 0x0~1000, object #9:55bf7cc6:::rbd_data.33992ae8944a.000000000000200f:e# OSD 46: 2017-08-21 12:41:03.531394 7fb396b1f700 -1 bluestore(/var/lib/ceph/osd/ceph-46) _verify_csum bad crc32c/0x1000 checksum at blob offset 0x0, got 0x7aa05c01, expected 0x6706be76, device location [0x1d6e1e0000~1000], logical extent 0x0~1000, object #9:55bf7cc6:::rbd_data.33992ae8944a.000000000000200f:e# This is on Ceph 12.1.4 (previously 12.1.1). Thoughts? ----- Edward Huyer School of Interactive Games and Media Rochester Institute of Technology Golisano 70-2373 152 Lomb Memorial Drive Rochester, NY 14623 585-475-6651 erh...@rit.edu<mailto:erh...@rit.edu> Obligatory Legalese: The information transmitted, including attachments, is intended only for the person(s) or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and destroy any copies of this information.
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
