[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
> > Hi, > > [root@ceph-iscsi-gw-1 ~]# gwcli ls > o- / > . > [...] > o- cluster > . > [Clusters: 1] > | o- ceph > > [HEALTH_OK] > | o- pools > . > [Pools: 22] > | | o- .rgw.root > .. [(x3), > Commit: 0.00Y/11532M (0%), Used: 52K] > | | o- cinder-ceph > [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] > | | o- default.rgw.buckets.data > . [(x3), Commit: > 0.00Y/11532M (0%), Used: 4587b] > | | o- default.rgw.buckets.extra > [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.buckets.index > [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.control > .. [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.data.root > [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.gc > ... [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.intent-log > ... [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.log > ... [(x3), Commit: > 0.00Y/11532M (0%), Used: 384K] > | | o- default.rgw.meta > ... [(x3), Commit: > 0.00Y/11532M (0%), Used: 24K] > | | o- default.rgw.usage > [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.users.email > .. [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.users.keys > ... [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.users.swift > .. [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- default.rgw.users.uid > [(x3), Commit: > 0.00Y/11532M (0%), Used: 0.00Y] > | | o- device_health_metrics > ... [(x3), Commit: 0.00Y/11532M > (0%), Used: 305303172b] > | | o- glance ... > [(x3), Commit: 0.00Y/11532M (0%), Used: 525074107902b] > | | o- gnocchi > . [(x3), Commit: > 0.00Y/11532M (0%), Used: 989498938b] > | | o- nova > ... [(x3), > Commit: 0.00Y/11532M (0%), Used: 12K] > | | o- rbd > [(x3), Commit: 20.0T/11532M (18%), Used: 3274867542037b] > | | o- scbench > .. [(x3), Commit: > 0.00Y/11532M (0%), Used: 88829964K] > | o- topology > .. > [OSDs: 108,MONs: 3] > o- disks > ... > [20.0T, Disks: 1] > | o- rbd > ... > [rbd (20.0T)] > | o- ceph-iscsi > ... > [rbd/ceph-iscsi (Online, 20.0T)] > o- iscsi-targets > ... > [DiscoveryAuth: None, Targets: 1] > o- iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw > . [Auth: None, > Gateways: 3] > o- disks > .. > [Disks: 1] > | o- rbd/ceph-iscsi > . [Owner: > ceph-iscsi-gw-1.ipa.pthl.hk, Lun: 0] > o- gateways > > [Up: 2/3, Portals: 3] > | o- ceph-iscsi-gw-1.ipa.pthl.hk >
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
Hi So you are using the default 'rbd' pool to store 'gateway.conf' config object. And the 'gateway.conf' is corrupted. If you couldn't remove it by using force option, then you should dump the 'gateway.conf' object from 'rbd' pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' related configures manually and then store it back. Then to see will it disappear, if not please restart the ceph-iscsi services. If you are not sure what should be deleted you can send it to me, I will help revise it for you. Thanks - Xiubo On 20/02/2023 09:20, luckydog xf wrote: Hi, [root@ceph-iscsi-gw-1 ~]# gwcli ls o- / . [...] o- cluster . [Clusters: 1] | o- ceph [HEALTH_OK] | o- pools . [Pools: 22] | | o- .rgw.root .. [(x3), Commit: 0.00Y/11532M (0%), Used: 52K] | | o- cinder-ceph [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] | | o- default.rgw.buckets.data . [(x3), Commit: 0.00Y/11532M (0%), Used: 4587b] | | o- default.rgw.buckets.extra [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.buckets.index [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.control .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.data.root [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.gc ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.intent-log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 384K] | | o- default.rgw.meta ... [(x3), Commit: 0.00Y/11532M (0%), Used: 24K] | | o- default.rgw.usage [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.email .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.keys ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.swift .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.uid [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- device_health_metrics ... [(x3), Commit: 0.00Y/11532M (0%), Used: 305303172b] | | o- glance ... [(x3), Commit: 0.00Y/11532M (0%), Used: 525074107902b] | | o- gnocchi . [(x3), Commit: 0.00Y/11532M (0%), Used: 989498938b] | | o- nova ... [(x3), Commit: 0.00Y/11532M (0%), Used: 12K] | | o- rbd [(x3), Commit: 20.0T/11532M (18%), Used: 3274867542037b] | | o- scbench .. [(x3), Commit: 0.00Y/11532M (0%), Used: 88829964K] | o- topology .. [OSDs: 108,MONs: 3] o- disks ... [20.0T, Disks: 1] | o- rbd ... [rbd (20.0T)] | o- ceph-iscsi ... [rbd/ceph-iscsi (Online
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
Hi, Xiubo. I'm not clear about the commands that dump and restore an object. Could you give me an example? `rados ls -p rbd` shows tons of uuids. https://docs.ceph.com/en/latest/man/8/rados/ On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li wrote: > Hi > > So you are using the default 'rbd' pool to store 'gateway.conf' config > object. > > And the 'gateway.conf' is corrupted. If you couldn't remove it by using > force option, then you should dump the 'gateway.conf' object from 'rbd' > pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' > related configures manually and then store it back. Then to see will it > disappear, if not please restart the ceph-iscsi services. > > If you are not sure what should be deleted you can send it to me, I will > help revise it for you. > > Thanks > > - Xiubo > On 20/02/2023 09:20, luckydog xf wrote: > > Hi, >> > > >> [root@ceph-iscsi-gw-1 ~]# gwcli ls >> o- / >> . >> [...] >> o- cluster >> . >> [Clusters: 1] >> | o- ceph >> >> [HEALTH_OK] >> | o- pools >> . >> [Pools: 22] >> | | o- .rgw.root >> .. [(x3), >> Commit: 0.00Y/11532M (0%), Used: 52K] >> | | o- cinder-ceph >> [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] >> | | o- default.rgw.buckets.data >> . [(x3), Commit: >> 0.00Y/11532M (0%), Used: 4587b] >> | | o- default.rgw.buckets.extra >> [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.buckets.index >> [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.control >> .. [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.data.root >> [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.gc >> ... [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.intent-log >> ... [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.log >> ... [(x3), Commit: >> 0.00Y/11532M (0%), Used: 384K] >> | | o- default.rgw.meta >> ... [(x3), Commit: >> 0.00Y/11532M (0%), Used: 24K] >> | | o- default.rgw.usage >> [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.users.email >> .. [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.users.keys >> ... [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.users.swift >> .. [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- default.rgw.users.uid >> [(x3), Commit: >> 0.00Y/11532M (0%), Used: 0.00Y] >> | | o- device_health_metrics >> ... [(x3), Commit: 0.00Y/11532M >> (0%), Used: 305303172b] >> | | o- glance ... >> [(x3), Commit: 0.00Y/11532M (0%), Used: 525074107902b] >> | | o- gnocchi >> . [(x3), Commit: >> 0.00Y/11532M (0%), Used: 989498938b] >> | | o- nova >> ... [(x3), >> Commit: 0.00Y/11532M (0%), Used: 12K] >> | | o- rbd >> [(x3), Commit: 20.0T/11532M (18%), Used: 3274867542037b] >> | | o- scbench >> .. [(x3), Commit: >> 0.00Y/11532M (0%), Used: 88829964K] >> | o- topology >> .. >> [OSDs: 108,MONs: 3] >> o- disks >> ... >> [20.0T, Disks: 1] >> | o- rbd >> ...
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
Oh, please forgive my carelessness. -- sudo rados -p rbd get gateway.conf local-gw.conf --- get all the contents. I'll try to edit it. On Mon, Feb 20, 2023 at 9:50 AM luckydog xf wrote: > Hi, Xiubo. > I'm not clear about the commands that dump and restore an object. Could > you give me an example? > `rados ls -p rbd` shows tons of uuids. > https://docs.ceph.com/en/latest/man/8/rados/ > > On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li wrote: > >> Hi >> >> So you are using the default 'rbd' pool to store 'gateway.conf' config >> object. >> >> And the 'gateway.conf' is corrupted. If you couldn't remove it by using >> force option, then you should dump the 'gateway.conf' object from 'rbd' >> pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' >> related configures manually and then store it back. Then to see will it >> disappear, if not please restart the ceph-iscsi services. >> >> If you are not sure what should be deleted you can send it to me, I will >> help revise it for you. >> >> Thanks >> >> - Xiubo >> On 20/02/2023 09:20, luckydog xf wrote: >> >> Hi, >>> >> >> >>> [root@ceph-iscsi-gw-1 ~]# gwcli ls >>> o- / >>> . >>> [...] >>> o- cluster >>> . >>> [Clusters: 1] >>> | o- ceph >>> >>> [HEALTH_OK] >>> | o- pools >>> . >>> [Pools: 22] >>> | | o- .rgw.root >>> .. [(x3), >>> Commit: 0.00Y/11532M (0%), Used: 52K] >>> | | o- cinder-ceph >>> [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] >>> | | o- default.rgw.buckets.data >>> . [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 4587b] >>> | | o- default.rgw.buckets.extra >>> [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.buckets.index >>> [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.control >>> .. [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.data.root >>> [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.gc >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.intent-log >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.log >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 384K] >>> | | o- default.rgw.meta >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 24K] >>> | | o- default.rgw.usage >>> [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.users.email >>> .. [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.users.keys >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.users.swift >>> .. [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- default.rgw.users.uid >>> [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 0.00Y] >>> | | o- device_health_metrics >>> ... [(x3), Commit: 0.00Y/11532M >>> (0%), Used: 305303172b] >>> | | o- glance >>> ... [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 525074107902b] >>> | | o- gnocchi >>> . [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 989498938b] >>> | | o- nova >>> ... [(x3), >>> Commit: 0.00Y/11532M (0%), Used: 12K] >>> | | o- rbd >>> [(x3), Commit: 20.0T/11532M (18%), Used: 3274867542037b] >>> | | o- scbench >>> .. [(x3), Commit: >>> 0.00Y/11532M (0%), Used: 88829964K] >>> | o- topology >>>
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
On 20/02/2023 10:11, luckydog xf wrote: Oh, please forgive my carelessness. -- sudo rados -p rbd get gateway.conf local-gw.conf --- get all the contents. I'll try to edit it. Correct. On Mon, Feb 20, 2023 at 9:50 AM luckydog xf wrote: Hi, Xiubo. I'm not clear about the commands that dump and restore an object. Could you give me an example? `rados ls -p rbd` shows tons of uuids. https://docs.ceph.com/en/latest/man/8/rados/ On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li wrote: Hi So you are using the default 'rbd' pool to store 'gateway.conf' config object. And the 'gateway.conf' is corrupted. If you couldn't remove it by using force option, then you should dump the 'gateway.conf' object from 'rbd' pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' related configures manually and then store it back. Then to see will it disappear, if not please restart the ceph-iscsi services. If you are not sure what should be deleted you can send it to me, I will help revise it for you. Thanks - Xiubo On 20/02/2023 09:20, luckydog xf wrote: Hi, [root@ceph-iscsi-gw-1 ~]# gwcli ls o- / . [...] o- cluster . [Clusters: 1] | o- ceph [HEALTH_OK] | o- pools . [Pools: 22] | | o- .rgw.root .. [(x3), Commit: 0.00Y/11532M (0%), Used: 52K] | | o- cinder-ceph [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] | | o- default.rgw.buckets.data . [(x3), Commit: 0.00Y/11532M (0%), Used: 4587b] | | o- default.rgw.buckets.extra [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.buckets.index [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.control .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.data.root [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.gc ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.intent-log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 384K] | | o- default.rgw.meta ... [(x3), Commit: 0.00Y/11532M (0%), Used: 24K] | | o- default.rgw.usage [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.email .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.keys ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.swift .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.uid [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- device_health_metrics ... [(x3), Commit: 0.00Y/11532M (0%), Used: 305303172b] | | o- glance ... [(x3), Commit: 0.00Y/11532M (0%), Used: 525074107902b
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
okay, I restored the correct configuration by 'sudo rados put gateway.conf local-gw -p rbd Now problems resolved. Thanks and have a nice day. On Mon, Feb 20, 2023 at 10:13 AM Xiubo Li wrote: > > On 20/02/2023 10:11, luckydog xf wrote: > > Oh, please forgive my carelessness. > -- > sudo rados -p rbd get gateway.conf local-gw.conf > --- > get all the contents. I'll try to edit it. > > Correct. > > > On Mon, Feb 20, 2023 at 9:50 AM luckydog xf wrote: > >> Hi, Xiubo. >> I'm not clear about the commands that dump and restore an object. Could >> you give me an example? >> `rados ls -p rbd` shows tons of uuids. >> https://docs.ceph.com/en/latest/man/8/rados/ >> >> On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li wrote: >> >>> Hi >>> >>> So you are using the default 'rbd' pool to store 'gateway.conf' config >>> object. >>> >>> And the 'gateway.conf' is corrupted. If you couldn't remove it by using >>> force option, then you should dump the 'gateway.conf' object from 'rbd' >>> pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' >>> related configures manually and then store it back. Then to see will it >>> disappear, if not please restart the ceph-iscsi services. >>> >>> If you are not sure what should be deleted you can send it to me, I will >>> help revise it for you. >>> >>> Thanks >>> >>> - Xiubo >>> On 20/02/2023 09:20, luckydog xf wrote: >>> >>> Hi, >>> >>> [root@ceph-iscsi-gw-1 ~]# gwcli ls o- / . [...] o- cluster . [Clusters: 1] | o- ceph [HEALTH_OK] | o- pools . [Pools: 22] | | o- .rgw.root .. [(x3), Commit: 0.00Y/11532M (0%), Used: 52K] | | o- cinder-ceph [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] | | o- default.rgw.buckets.data . [(x3), Commit: 0.00Y/11532M (0%), Used: 4587b] | | o- default.rgw.buckets.extra [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.buckets.index [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.control .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.data.root [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.gc ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.intent-log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 384K] | | o- default.rgw.meta ... [(x3), Commit: 0.00Y/11532M (0%), Used: 24K] | | o- default.rgw.usage [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.email .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.keys ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.swift .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.uid [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- device_health_metrics ... [(x3), Commit: 0.00Y/11532M (0%), Used: 305303172b] | | o- glance ... [(x3), Commit: 0.00Y/11532M (0%), Used: 525074107902b] | | o- gnocchi . [(x3), Commit: 0.00Y/11532M (0%), Used: 989498938b] | | o- nova ... [(x3), Commit: 0.00Y/11532M (0%), Used: 12K]
[ceph-users] Re: ceph-iscsi-cli: cannot remove duplicated gateways.
Cool :-) On 20/02/2023 10:19, luckydog xf wrote: okay, I restored the correct configuration by 'sudo rados put gateway.conf local-gw -p rbd Now problems resolved. Thanks and have a nice day. On Mon, Feb 20, 2023 at 10:13 AM Xiubo Li wrote: On 20/02/2023 10:11, luckydog xf wrote: Oh, please forgive my carelessness. -- sudo rados -p rbd get gateway.conf local-gw.conf --- get all the contents. I'll try to edit it. Correct. On Mon, Feb 20, 2023 at 9:50 AM luckydog xf wrote: Hi, Xiubo. I'm not clear about the commands that dump and restore an object. Could you give me an example? `rados ls -p rbd` shows tons of uuids. https://docs.ceph.com/en/latest/man/8/rados/ On Mon, Feb 20, 2023 at 9:30 AM Xiubo Li wrote: Hi So you are using the default 'rbd' pool to store 'gateway.conf' config object. And the 'gateway.conf' is corrupted. If you couldn't remove it by using force option, then you should dump the 'gateway.conf' object from 'rbd' pool and then delete the 'ceph-iscsi-gw-1.ipa.pthl.hklocalhost.localdomain' related configures manually and then store it back. Then to see will it disappear, if not please restart the ceph-iscsi services. If you are not sure what should be deleted you can send it to me, I will help revise it for you. Thanks - Xiubo On 20/02/2023 09:20, luckydog xf wrote: Hi, [root@ceph-iscsi-gw-1 ~]# gwcli ls o- / . [...] o- cluster . [Clusters: 1] | o- ceph [HEALTH_OK] | o- pools . [Pools: 22] | | o- .rgw.root .. [(x3), Commit: 0.00Y/11532M (0%), Used: 52K] | | o- cinder-ceph [(x3), Commit: 0.00Y/11532M (0%), Used: 28703946995700b] | | o- default.rgw.buckets.data . [(x3), Commit: 0.00Y/11532M (0%), Used: 4587b] | | o- default.rgw.buckets.extra [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.buckets.index [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.control .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.data.root [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.gc ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.intent-log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.log ... [(x3), Commit: 0.00Y/11532M (0%), Used: 384K] | | o- default.rgw.meta ... [(x3), Commit: 0.00Y/11532M (0%), Used: 24K] | | o- default.rgw.usage [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.email .. [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.keys ... [(x3), Commit: 0.00Y/11532M (0%), Used: 0.00Y] | | o- default.rgw.users.swift
