This is the documentation that has always worked for me to set up multiple realms. http://docs.ceph.com/docs/luminous/radosgw/multisite/ It's for the multisite configuration, but if you aren't using multi-site, just stop after setting up the first site. I didn't read through all of your steps, but I've never had a problem following these steps. Make sure to replace 'luminous' with your ceph version if it isn't luminous. One thing I noticed in Luminous is that you only need like 5 metadata pools for RGW now due to namespaces in the pools.
On Wed, May 30, 2018 at 11:38 AM Brett Chancellor < bchancel...@salesforce.com> wrote: > Hi All, > I'm having issues trying to get a 2nd Rados GW realm/zone up and > running. The configuration seemed to go well, but I'm unable to start the > gateway. > > 2018-05-29 21:21:27.119192 7fd26cfdd9c0 0 ERROR: failed to decode obj > from .rgw.root:zone_info.fe2e0680-d7e8-415f-bf91-501dda96d075 > 2018-05-29 21:21:27.119198 7fd26cfdd9c0 0 replace_region_with_zonegroup: > error initializing default zone params: (5) Input/output error > 2018-05-29 21:21:27.119207 7fd26cfdd9c0 -1 failed converting region to > zonegroup : ret -5 (5) Input/output error > 2018-05-29 21:21:27.120479 7fd26cfdd9c0 1 -- 10.252.174.9:0/3447328109 > mark_down > 0x55dddc157a30 -- 0x55dddc153630 > 2018-05-29 21:21:27.122221 7fd26cfdd9c0 1 -- 10.252.174.9:0/3447328109 > mark_down_all > 2018-05-29 21:21:27.122393 7fd26cfdd9c0 1 -- 10.252.174.9:0/3447328109 > shutdown > complete. > 2018-05-29 21:21:27.122800 7fd26cfdd9c0 -1 Couldn't init storage provider > (RADOS) > > Existing RadosGW .. this one works fine > Realm : realm01 (default) > zonegroup: us (master, default) > zone: us-prd-1 (master, default) > > The problem comes when I'm attempting to add a new realm. > New Realm: realmtest > new ZG: maintest (master) > new zone: lumtest (master) > > Steps taken: > ========= > * Created new rgw pools lumtest.rgw.* (14 pools) on dedicated root > * radosgw-admin realm create --rgw-realm=realmtest > * radosgw-admin zonegroup create --rgw-zonegroup=maintest > --rgw-realm=realmtest --master > * radosgw-admin zone create --rgw-realm=realmtest --rgw-zonegroup=maintest > --rgw-zone=lumtest --master > * radosgw-admin user create --rgw-realm realmtest --rgw-zonegroup maintest > --rgw-zone lumtest --uid="REMOVED" --display-name="System User" --system > * radosgw-admin zone modify -rgw-realm realmtest --rgw-zonegroup maintest > --rgw-zone lumtest [added the access key and secret of system user] > * radosgw-admin user create --rgw-realm realmtest --rgw-zonegroup > maintest --rgw-zone lumtest --uid="test" --display-name="test User" > * radosgw-admin period update --rgw-realm realmtest > > ceph.conf > ======== > [client.radosgw.rgw-test] > host = rgw-test > keyring = /etc/ceph/ceph.client.radosgw.rgw-test > log file = /var/log/ceph/radosgw.rgw-test > rgw frontends = civetweb port=80 > rgw realm=realmtest > rgw zonegroup=maintest > rgw zone=lumtest > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com