Josh & Sebastien, Does either of you have any comments on this cephx issue with multi-rbd backend pools? Thx. --weiguo From: ws...@hotmail.com To: ceph-users@lists.ceph.com Date: Thu, 20 Jun 2013 17:58:34 +0000 Subject: [ceph-users] Openstack Multi-rbd storage backend
Anyone saw the same issue as below? We are trying to test the multi backend feature with two RBD pools on Grizzly release. At this point, it seems that rbd.py does not take separate cephx users for the two RBD pools for authentication as it defaults to the single ID defined in /etc/init/cinder-volume.conf, which is documented here with "env CEPH_ARGS="--id volume" http://ceph.com/docs/master/rbd/rbd-openstack/#configuring-cinder-nova-volume It seems to us that rbd.py is ignoring the separate "rbd_user=" configuration for each storage backend section, [svl-stack-mgmt-openstack-volumes-2]volume_driver=cinder.volume.drivers.rbd.RBDDriverrbd_pool=stack-mgmt-openstack-volumes-2rbd_user=stack-mgmt-openstack-volumes-2rbd_secret_uuid=e1124cad-55e8-d4ce-6c68-5f40491b15efvolume_backend_name=RBD_CINDER_VOLUMES_3 Here is the error from cinder-volume.log, ----------------------------------------- File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/rbd.py", line 144, in delete_volume volume['name']) File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 190, in execute cmd=' '.join(cmd))ProcessExecutionError: Unexpected error while running command.Command: rbd snap ls --pool svl-stack-mgmt-openstack-volumes-2 volume-9f1735ae-b31f-4cd5-a279-f879692839c3Exit code: 1Stdout: ''Stderr: 'rbd: error opening image volume-9f1735ae-b31f-4cd5-a279-f879692839c3: (1) Operation not permitted\n2013-06-20 10:41:46.591363 7f68117a9780 -1 librbd::ImageCtx: error finding header: (1) Operation not permitted\n'------------------------------------------- _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com