Hi all, During last week I been trying to deploy the pre-existing ceph cluster with out openstack intance. The ceph-cinder integration was easy (or at least I think so!!) There is only one volume to attach block storage to out cloud machines.
The client.cinder has permission on this volume (following the guides) ............... client.cinder key: AQAonXXXXXXXRAAPIAj9iErv001a0k+vyFdUg== caps: [mon] allow r *caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=volumes* ceph.conf file seems to be OK: *[global]* *fsid = 6f5a65a7-316c-4825-afcb-428608941dd1* *mon_initial_members = cephadm, cephmon02, cephmon03* *mon_host = 10.10.3.1,10.10.3.2,10.10.3.3* *auth_cluster_required = cephx* *auth_service_required = cephx* *auth_client_required = cephx* *filestore_xattr_use_omap = true* *osd_pool_default_size = 2* *public_network = 10.10.0.0/16 <http://10.10.0.0/16>* *cluster_network = 192.168.254.0/27 <http://192.168.254.0/27>* *[osd]* *osd_journal_size = 20000* *[client.cinder]* *keyring = /etc/ceph/ceph.client.cinder.keyring* *[client]* *rbd cache = true* *rbd cache writethrough until flush = true* *admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok* The trouble seems that blocks are created using the client.admin instead of client.cinder >From cinder machine: cinder:~ # rados ls --pool volumes rbd_id.volume-5e2ab5c2-4710-4c28-9755-b5bc4ff6a52a rbd_directory rbd_id.volume-7da08f12-fb0f-4269-931a-d528c1507fee rbd_header.23d5e33b4c15c rbd_header.20407190ce77f But if I try to look for using cinder client: cinder:~ #rados ls --pool volumes --secret client.cinder "empty answer" cinder:~ # ls -la /etc/ceph total 24 drwxr-xr-x 2 root root 4096 nov 3 10:17 . drwxr-xr-x 108 root root 4096 oct 29 09:52 .. -rw------- 1 root root 63 nov 3 10:17 ceph.client.admin.keyring -rw-r--r-- 1 cinder cinder 67 oct 28 13:44 ceph.client.cinder.keyring -rw-r--r-- 1 root root 454 oct 1 13:56 ceph.conf -rw-r--r-- 1 root root 73 sep 27 09:36 ceph.mon.keyring from a client (I have supposed that this machine only need the cinder key...) cloud28:~ # ls -la /etc/ceph/ total 28 drwx------ 2 root root 4096 nov 3 11:01 . drwxr-xr-x 116 root root 12288 oct 30 14:37 .. -rw-r--r-- 1 nova nova 67 oct 28 11:43 ceph.client.cinder.keyring -rw-r--r-- 1 root root 588 nov 3 10:59 ceph.conf -rw-r--r-- 1 root root 92 oct 26 16:59 rbdmap cloud28:~ # rbd -p volumes ls 2015-11-03 11:01:58.782795 7fc6c714b840 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2015-11-03 11:01:58.782800 7fc6c714b840 0 librados: client.admin initialization error (2) No such file or directory rbd: couldn't connect to the cluster! Any help will be welcome.
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com