EP, Try setting the crush map to use legacy tunables. I've had the same issue with the"feature mismatch" errors when using krbd that didn't support format 2 and running jewel 10.2.2 on the storage nodes.
From the command line: ceph osd crush tunables legacy Bruce > On Aug 16, 2016, at 4:21 PM, Somnath Roy <somnath....@sandisk.com> wrote: > > This is usual feature mismatch stuff , the inbox krbd you are using is not > supporting Jewel. > Try googling with the error and I am sure you will get lot of prior > discussion around that.. > > From: EP Komarla [mailto:ep.koma...@flextronics.com] > Sent: Tuesday, August 16, 2016 4:15 PM > To: Somnath Roy; ceph-users@lists.ceph.com > Subject: RE: Rbd map command doesn't work > > Somnath, > > Thanks. > > I am trying your suggestion. See the commands below. Still it doesn’t seem > to go. > > I am missing something here… > > Thanks, > > - epk > > ============= > [test@ep-c2-client-01 ~]$ rbd create rbd/test1 --size 1G --image-format 1 > rbd: image format 1 is deprecated > [test@ep-c2-client-01 ~]$ rbd map rbd/test1 > rbd: sysfs write failed > In some cases useful info is found in syslog - try "dmesg | tail" or so. > rbd: map failed: (13) Permission denied > [test@ep-c2-client-01 ~]$ sudo rbd map rbd/test1 > ^C[test@ep-c2-client-01 ~]$ > [test@ep-c2-client-01 ~]$ > [test@ep-c2-client-01 ~]$ > [test@ep-c2-client-01 ~]$ > [test@ep-c2-client-01 ~]$ dmesg|tail -20 > [1201954.248195] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1201954.253365] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1201964.274082] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1201964.281195] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1201974.298195] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1201974.305300] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204128.917562] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204128.924173] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204138.956737] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204138.964011] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204148.980701] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204148.987892] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204159.004939] libceph: mon2 172.20.60.53:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204159.012136] libceph: mon2 172.20.60.53:6789 missing required protocol > features > [1204169.028802] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204169.035992] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204476.803192] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1204476.810578] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1204486.821279] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > > > > From: Somnath Roy [mailto:somnath....@sandisk.com] > Sent: Tuesday, August 16, 2016 3:59 PM > To: EP Komarla <ep.koma...@flextronics.com>; ceph-users@lists.ceph.com > Subject: RE: Rbd map command doesn't work > > The default format of rbd image in jewel is 2 along with bunch of other > deatures enabled , so, you have following two option: > > 1. create a format 1 image –image-format 1 > > 2. Or, do this in the ceph.conf file [client] or [global] before creating > image.. > rbd_default_features = 3 > > Thanks & Regards > Somnath > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of EP > Komarla > Sent: Tuesday, August 16, 2016 2:52 PM > To: ceph-users@lists.ceph.com > Subject: [ceph-users] Rbd map command doesn't work > > All, > > I am creating an image and mapping it. The below commands used to work in > Hammer, now the same is not working in Jewel. I see the message about some > feature set mismatch – what features are we talking about here? Is this a > known issue in Jewel with a workaround? > > Thanks, > > - epk > > ========= > > > [test@ep-c2-client-01 ~]$ rbd create rbd/test1 --size 1G > [test@ep-c2-client-01 ~]$ rbd info test1 > rbd image 'test1': > size 1024 MB in 256 objects > order 22 (4096 kB objects) > block_name_prefix: rbd_data.8146238e1f29 > format: 2 > features: layering, exclusive-lock, object-map, fast-diff, > deep-flatten > flags: > [test@ep-c2-client-01 ~]$ rbd map rbd/test1 > rbd: sysfs write failed > In some cases useful info is found in syslog - try "dmesg | tail" or so. > rbd: map failed: (13) Permission denied > [test@ep-c2-client-01 ~]$ dmesg|tail > [1197731.547522] libceph: mon1 172.20.60.52:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1197731.554621] libceph: mon1 172.20.60.52:6789 missing required protocol > features > [1197741.571645] libceph: mon2 172.20.60.53:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1197741.578760] libceph: mon2 172.20.60.53:6789 missing required protocol > features > [1198586.766120] libceph: mon1 172.20.60.52:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1198586.771248] libceph: mon1 172.20.60.52:6789 missing required protocol > features > [1198596.789453] libceph: mon0 172.20.60.51:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1198596.796557] libceph: mon0 172.20.60.51:6789 missing required protocol > features > [1198606.813825] libceph: mon1 172.20.60.52:6789 feature set mismatch, my > 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000 > [1198606.820929] libceph: mon1 172.20.60.52:6789 missing required protocol > features > [test@ep-c2-client-01 ~]$ sudo rbd map rbd/test1 > > > EP KOMARLA, > <image001.png> > Emal: ep.koma...@flextronics.com > Address: 677 Gibraltor Ct, Building #2, Milpitas, CA 94035, USA > Phone: 408-674-6090 (mobile) > > > Legal Disclaimer: > The information contained in this message may be privileged and confidential. > It is intended to be read only by the individual or entity to whom it is > addressed or by their designee. If the reader of this message is not the > intended recipient, you are on notice that any distribution of this message, > in any form, is strictly prohibited. If you have received this message in > error, please immediately notify the sender and delete or destroy any copy of > this message! > PLEASE NOTE: The information contained in this electronic mail message is > intended only for the use of the designated recipient(s) named above. If the > reader of this message is not the intended recipient, you are hereby notified > that you have received this message in error and that any review, > dissemination, distribution, or copying of this message is strictly > prohibited. If you have received this communication in error, please notify > the sender by telephone or e-mail (as shown above) immediately and destroy > any and all copies of this message in your possession (whether hard copies or > electronically stored copies). > > Legal Disclaimer: > The information contained in this message may be privileged and confidential. > It is intended to be read only by the individual or entity to whom it is > addressed or by their designee. If the reader of this message is not the > intended recipient, you are on notice that any distribution of this message, > in any form, is strictly prohibited. If you have received this message in > error, please immediately notify the sender and delete or destroy any copy of > this message! > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
