Hi,
I’m trying run a Gerrit deployment on kubernetes. The deployment fails because
the it can’t mount a ceph image with rbd-nbd.
I tried to manually mount the image with "sudo rbd-nbd map rbd/xgrid-rep-test
-m 172.31.141.8:6789,172.31.141.9:6789,172.31.141.10:6789 --keyfile keyfile"
and it works.
Here's the log for the pod:
Warning FailedMount 10m kubelet, worker3 MountVolume.WaitForAttach failed
for volume "pv-gerrit" : fail to check rbd image status with: (exit status 22),
rbd output: (2019-01-16 07:51:27.300452 7f66ea174100 -1 did not load config
file, using default settings.
2019-01-16 07:51:27.304427 7f66ea174100 -1 auth: unable to find a keyring on
/etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin:
(2) No such file or directory
2019-01-16 07:51:27.304509 7f66ea174100 -1 auth: failed to decode key
'AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg'
2019-01-16 07:51:27.304516 7f66ea174100 0 librados: client.admin
initialization error (22) Invalid argument
rbd: couldn't connect to the cluster!
)
Warning FailedMount 1m (x5 over 9m) kubelet, worker3 (combined from
similar events): MountVolume.WaitForAttach failed for volume "pv-gerrit" : fail
to check rbd image status with: (exit status 22), rbd output: (2019-01-16
08:00:41.288005 7f2f01c1d100 -1 auth: failed to decode key
'AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg'
2019-01-16 08:00:41.288019 7f2f01c1d100 0 librados: client.admin
initialization error (22) Invalid argument
rbd: couldn't connect to the cluster!
)
Warning FailedMount 36s (x6 over 11m) kubelet, worker3 Unable to mount
volumes for pod
"gerrit-deployment-559c6fc6b5-9drpr_default(ffd798de-198c-11e9-b99a-fcaa1476b110)":
timeout expired waiting for volumes to attach or mount for pod
"default"/"gerrit-deployment-559c6fc6b5-9drpr". list of unmounted
volumes=[gerrit-data]. list of unattached volumes=[gerrit-data
default-token-cc5fj]
I double checked the keys in /etc/ceph/ceph.client.admin.keyring on worker3
(copied them from a ceph moniter node)
[client.admin]
key = AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg==
caps mds = "allow *"
caps mgr = "allow *"
caps mon = "allow *"
caps osd = "allow *"
Any idea what the issue with the key might be?
Best
-H_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
