Hi Craig, I am testing the federated gateway of 1 region with 2 zones. And I found only metadata is replicated, the data is NOT. According to your check list, I am sure all thinks are checked. Could you review my configuration scripts? The configuration files are similar to http://docs.ceph.com/docs/master/radosgw/federated-config/.
1. For the master zone with 5 nodes of the region (1) create keyring sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-east-1 --gen-key sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-west-1 --gen-key sudo ceph-authtool -n client.radosgw.us-east-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring sudo ceph-authtool -n client.radosgw.us-west-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring (2) modify Ceph cluster configurations and synchronize it ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5 (3) configure Apache (4) configure region sudo apt-get install -y radosgw radosgw-agent python-pip sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-east-1 sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-west-1 sudo rados -p .us.rgw.root rm region_info.default sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1 sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (5) create master zone sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-west-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-west-1 sudo rados -p .rgw.root rm zone_info.default sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (6) create master zone's users sudo radosgw-admin user create --uid="us-east" --display-name="Region-us Zone-East" --name client.radosgw.us-east-1 --system --access_key=us_access_key --secret=us_secret_key sudo radosgw-admin user create --uid="us-west" --display-name="Region-us Zone-West" --name client.radosgw.us-west-1 --system --access_key=us_access_key --secret=us_secret_key (7) restart Ceph & apache2 & radosgw services 2. For the secondary zone with 5 nodes of the region (1) copy the keyring file 'ceph.client.radosgw.keyring' from master zone and import the keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring (2) modify Ceph cluster configurations and synchronize it ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5 (3) configure Apache (4) copy infile '/home/ceph/us.json' for the master zone and create 'us' region sudo apt-get install -y radosgw radosgw-agent python-pip sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-east-1 sudo radosgw-admin region set --infile /home/ceph/us.json --name client.radosgw.us-west-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1 sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1 sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (5) create secondary one sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-east --infile /home/ceph/us-east.json --name client.radosgw.us-west-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-east-1 sudo radosgw-admin zone set --rgw-zone=us-west --infile /home/ceph/us-west.json --name client.radosgw.us-west-1 sudo rados -p .rgw.root rm zone_info.default sudo radosgw-admin regionmap update --name client.radosgw.us-east-1 sudo radosgw-admin regionmap update --name client.radosgw.us-west-1 (6) create secondary zone's users sudo radosgw-admin user create --uid="us-east" --display-name="Region-us Zone-East" --name client.radosgw.us-east-1 --system --access_key=us_access_key --secret=us_secret_key sudo radosgw-admin user create --uid="us-west" --display-name="Region-us Zone-West" --name client.radosgw.us-west-1 --system --access_key=us_access_key --secret=us_secret_key (7) restart Ceph & apache2 & radosgw services Any help would be much appreciated. Best Regards, wdhwang --------------------------------------------------------------------------------------------------------------------------------------------------------------- This email contains confidential or legally privileged information and is for the sole use of its intended recipient. Any unauthorized review, use, copying or distribution of this email or the content of this email is strictly prohibited. If you are not the intended recipient, you may reply to the sender and should delete this e-mail immediately. ---------------------------------------------------------------------------------------------------------------------------------------------------------------
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
