Hi Cephians, I wonder if someone has seen this before.
Every day between 3:09am and 3:19am I'm seeing those entries in the logfile on ONE of the 2 OSD nodes of my cluster. 3:09 is the time where I start to backup my qemu/kvm-VM images, which are stored as objects in CEPH. For that, I first "sync" the VM OS, then create a CEPH snapshot of the VM image and then copy this snapshot to an external disk. After that is done, the snapshot gets deleted and the next VM is processed. The backup of the 7 VM images takes roughly 10 minutes. Later during the day I do not see those messages anymore. Anyone any idea what they are caused by ? The cluster is Healthy and I do not see any problems at all. Just these messages in the syslog. Many Thanks Dieter Aug 24 03:09:03 muc1 kernel: [25906051.274363] EXT4-fs (dm-4): mounted filesystem with ordered data mode. Opts: (null) Aug 24 03:09:05 muc1 ceph-osd[11276]: 2017-08-24 03:09:05.507291 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e8910665:::inc_osdmap.6265:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6265__0_A6608917__none) in index: (61) No data available Aug 24 03:09:05 muc1 ceph-osd[11276]: 2017-08-24 03:09:05.508160 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:15dee050:::osdmap.6265:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6265__0_0A077BA8__none) in index: (61) No data available Aug 24 03:10:00 muc1 ceph-osd[11276]: 2017-08-24 03:10:00.416815 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e5710665:::inc_osdmap.6266:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6266__0_A6608EA7__none) in index: (61) No data available Aug 24 03:10:00 muc1 ceph-osd[11276]: 2017-08-24 03:10:00.417142 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1edee050:::osdmap.6266:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6266__0_0A077B78__none) in index: (61) No data available Aug 24 03:10:02 muc1 ceph-osd[11276]: 2017-08-24 03:10:02.596619 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ee710665:::inc_osdmap.6267:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6267__0_A6608E77__none) in index: (61) No data available Aug 24 03:10:02 muc1 ceph-osd[11276]: 2017-08-24 03:10:02.596706 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:101ee050:::osdmap.6267:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6267__0_0A077808__none) in index: (61) No data available Aug 24 03:12:14 muc1 ceph-osd[11276]: 2017-08-24 03:12:14.773422 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e0f10665:::inc_osdmap.6268:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6268__0_A6608F07__none) in index: (61) No data available Aug 24 03:12:14 muc1 ceph-osd[11276]: 2017-08-24 03:12:14.786772 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1b9ee050:::osdmap.6268:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6268__0_0A0779D8__none) in index: (61) No data available Aug 24 03:12:17 muc1 ceph-osd[11276]: 2017-08-24 03:12:17.476468 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:eb310665:::inc_osdmap.6269:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6269__0_A6608CD7__none) in index: (61) No data available Aug 24 03:12:17 muc1 ceph-osd[11276]: 2017-08-24 03:12:17.476609 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:169ee050:::osdmap.6269:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6269__0_0A077968__none) in index: (61) No data available Aug 24 03:14:08 muc1 ceph-osd[11276]: 2017-08-24 03:14:08.295982 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ecb10665:::inc_osdmap.6270:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6270__0_A6608D37__none) in index: (61) No data available Aug 24 03:14:08 muc1 ceph-osd[11276]: 2017-08-24 03:14:08.296278 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:13fee050:::osdmap.6270:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6270__0_0A077FC8__none) in index: (61) No data available Aug 24 03:14:09 muc1 ceph-osd[11276]: 2017-08-24 03:14:09.381778 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e3410665:::inc_osdmap.6271:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6271__0_A66082C7__none) in index: (61) No data available Aug 24 03:14:09 muc1 ceph-osd[11276]: 2017-08-24 03:14:09.397770 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:193ee050:::osdmap.6271:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6271__0_0A077C98__none) in index: (61) No data available Aug 24 03:15:05 muc1 ceph-osd[11276]: 2017-08-24 03:15:05.290743 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e9c10665:::inc_osdmap.6272:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6272__0_A6608397__none) in index: (61) No data available Aug 24 03:15:05 muc1 ceph-osd[11276]: 2017-08-24 03:15:05.290888 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:143ee050:::osdmap.6272:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6272__0_0A077C28__none) in index: (61) No data available Aug 24 03:15:06 muc1 ceph-osd[11276]: 2017-08-24 03:15:06.545915 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e4c10665:::inc_osdmap.6273:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6273__0_A6608327__none) in index: (61) No data available Aug 24 03:15:06 muc1 ceph-osd[11276]: 2017-08-24 03:15:06.546051 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1fbee050:::osdmap.6273:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6273__0_0A077DF8__none) in index: (61) No data available Aug 24 03:16:05 muc1 ceph-osd[11276]: 2017-08-24 03:16:05.140376 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ef010665:::inc_osdmap.6274:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6274__0_A66080F7__none) in index: (61) No data available Aug 24 03:16:05 muc1 ceph-osd[11276]: 2017-08-24 03:16:05.140525 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:114ee050:::osdmap.6274:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6274__0_0A077288__none) in index: (61) No data available Aug 24 03:16:06 muc1 ceph-osd[11276]: 2017-08-24 03:16:06.397144 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e1810665:::inc_osdmap.6275:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6275__0_A6608187__none) in index: (61) No data available Aug 24 03:16:06 muc1 ceph-osd[11276]: 2017-08-24 03:16:06.397342 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1a4ee050:::osdmap.6275:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6275__0_0A077258__none) in index: (61) No data available Aug 24 03:17:56 muc1 ceph-osd[11276]: 2017-08-24 03:17:56.628233 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ea810665:::inc_osdmap.6276:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6276__0_A6608157__none) in index: (61) No data available Aug 24 03:17:56 muc1 ceph-osd[11276]: 2017-08-24 03:17:56.628486 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:17cee050:::osdmap.6276:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6276__0_0A0773E8__none) in index: (61) No data available Aug 24 03:17:57 muc1 ceph-osd[11276]: 2017-08-24 03:17:57.893578 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:e7610665:::inc_osdmap.6277:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6277__0_A66086E7__none) in index: (61) No data available Aug 24 03:17:57 muc1 ceph-osd[11276]: 2017-08-24 03:17:57.893713 7f08641cf700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:1d0ee050:::osdmap.6277:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6277__0_0A0770B8__none) in index: (61) No data available Aug 24 03:19:42 muc1 ceph-osd[11276]: 2017-08-24 03:19:42.176583 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:ede10665:::inc_osdmap.6278:0# (/var/lib/ceph/osd/ceph-4/current/meta/inc\uosdmap.6278__0_A66087B7__none) in index: (61) No data available Aug 24 03:19:42 muc1 ceph-osd[11276]: 2017-08-24 03:19:42.186388 7f08649d0700 -1 filestore(/var/lib/ceph/osd/ceph-4) error creating #-1:120ee050:::osdmap.6278:0# (/var/lib/ceph/osd/ceph-4/current/meta/osdmap.6278__0_0A077048__none) in index: (61) No data available
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
