[ceph-users] Help on RGW NFS function

2016-09-21 Thread yiming xie
Hi,
I have some question about rgw nfs.

ceph release notes: You can now access radosgw buckets via NFS (experimental).
In addition to the sentence, ceph documents does not do any explanation
I don't understand the experimental implications.

1. RGW nfs functional integrity of it? If nfs function is not complete, which 
features missing?
2. How stable is the RGW nfs?
3. RGW nfs latest version can be used in a production environment yet?

Please reply to my question as soon as possible. Very grateful, thank you!


 plato.xie___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] librgw init failed (-5) when starting nfs-ganesha

2016-10-08 Thread yiming xie
> 
> I start nfs-ganesha with FSAL_RGW failed, the nfs-ganesha log is: 
> "create_export :FSAL :CRIT :RGW module: librgw init failed (-5)”
> 
> ceph/src/rgw/librgw.cc :
> int librgw_create(librgw_t* rgw, int argc, char **argv) 
> this interface return value equal -5 and it’s parameters as below:
> 
> argc=2
> argv[0] = “nfs-ganesha”
> argv[1] = “--conf=/etc/ceph/ceph.conf”
> 
> env:
> nfs-genahsa(2.3)
> librgw.so.2.0.0

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] librgw init failed (-5) when starting nfs-ganesha

2016-10-09 Thread yiming xie
Thank your reply. I don’t know which configuration or step causes rados 
initialization to fail。
/usr/lib64/
librgw.so.2.0.0
librados.so.2.0.0

/etc/ceh/ceph.conf:
[global]
mon_host = 192.168.77.61



> 在 2016年10月9日,下午4:33,Brad Hubbard  写道:
> 
> Looks to me like it may have failed to initialise RADOS. Do you have librados
> installed and configured (ceph.conf, etc.)?
> 
> librgw_create -> 
>  -> RGWLib::init
>-> RGWStoreManager::get_storage
>  -> RGWStoreManager::init_storage_provider
>-> RGWRados::initialize
>  -> init_rados
> 
> -- 
> HTH,
> Brad
> 
> On Sun, Oct 9, 2016 at 2:02 PM, yiming xie  wrote:
>> 
>> I start nfs-ganesha with FSAL_RGW failed, the nfs-ganesha log is: 
>> "create_export :FSAL :CRIT :RGW module: librgw init failed (-5)”
>> 
>> ceph/src/rgw/librgw.cc:
>> int librgw_create(librgw_t* rgw, int argc, char **argv) 
>> this interface return value equal -5 and it’s parameters as below:
>> 
>> argc=2
>> argv[0] = “nfs-ganesha”
>> argv[1] = “--conf=/etc/ceph/ceph.conf”
>> 
>> env:
>> nfs-genahsa(2.3)
>> librgw.so.2.0.0
>> 
>> 
>> 
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> 
> 
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] librgw init failed (-5) when starting nfs-ganesha

2016-10-09 Thread yiming xie
ceph -v
ceph version 10.2.3 (ecc23778eb545d8dd55e2e4735b53cc93f92e65b)
nfs-ganesha:2.3 stable 

1. install ceph following docs.ceph.com  on node1
2.install librgw2-devel.x86_64 on node2
3.install nfs-ganmesha on node2
  cmake -DUSE_FSAL_RGW=ON ../src/
  make
  make install
 
4.vi /etc/cep/ceph.conf on node2
>> [global]
>> mon_host = 192.168.77.61

5 create ganesha.conf
EXPORT
{
Export_ID=1;

Path = "/";

Pseudo = "/";

Access_Type = RW;

NFS_Protocols = 4;

Transport_Protocols = TCP;

FSAL {
Name = RGW;
User_Id = “admin";
Access_Key_Id =“admin";
Secret_Access_Key = “admin";
}
}

RGW {
ceph_conf = "/etc/ceph/ceph.conf";
}

6.sudo /usr/bin/ganesha.nfsd -L /var/log/ganesha.log -f 
/etc/ganesha/ganesha.conf -N NIV_EVENT -p /var/run/ganesha.nfsd.pid



> 在 2016年10月10日,下午2:17,Brad Hubbard  写道:
> 
> On Sun, Oct 9, 2016 at 9:58 PM, yiming xie  wrote:
>> Thank your reply. I don’t know which configuration or step causes rados 
>> initialization to fail。
>> /usr/lib64/
>> librgw.so.2.0.0
>> librados.so.2.0.0
>> 
>> /etc/ceh/ceph.conf:
>> [global]
>> mon_host = 192.168.77.61
> 
> What document are you following and what version of ceph and
> nfs-ganesha are you running?
> 
> What configuration have you changed up to this point?
> 
>> 
>> 
>> 
>>> 在 2016年10月9日,下午4:33,Brad Hubbard  写道:
>>> 
>>> Looks to me like it may have failed to initialise RADOS. Do you have 
>>> librados
>>> installed and configured (ceph.conf, etc.)?
>>> 
>>> librgw_create ->
>>> -> RGWLib::init
>>>   -> RGWStoreManager::get_storage
>>> -> RGWStoreManager::init_storage_provider
>>>   -> RGWRados::initialize
>>> -> init_rados
>>> 
>>> --
>>> HTH,
>>> Brad
>>> 
>>> On Sun, Oct 9, 2016 at 2:02 PM, yiming xie  wrote:
>>>> 
>>>> I start nfs-ganesha with FSAL_RGW failed, the nfs-ganesha log is:
>>>> "create_export :FSAL :CRIT :RGW module: librgw init failed (-5)”
>>>> 
>>>> ceph/src/rgw/librgw.cc:
>>>> int librgw_create(librgw_t* rgw, int argc, char **argv)
>>>> this interface return value equal -5 and it’s parameters as below:
>>>> 
>>>> argc=2
>>>> argv[0] = “nfs-ganesha”
>>>> argv[1] = “--conf=/etc/ceph/ceph.conf”
>>>> 
>>>> env:
>>>> nfs-genahsa(2.3)
>>>> librgw.so.2.0.0
>>>> 
>>>> 
>>>> 
>>>> ___
>>>> ceph-users mailing list
>>>> ceph-users@lists.ceph.com
>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>> 
>>> 
>>> 
>> 
> 
> 
> 
> -- 
> Cheers,
> Brad

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] librgw init failed (-5) when starting nfs-ganesha

2016-10-10 Thread yiming xie
Order by your advice, I install ganesha on node1,but there be a same problem.
  librgw init failed (-5)

node1:
 ps -ef | grep ceph 
ceph  1099 1  0 17:34 ?00:00:00 /usr/bin/radosgw -f 
--clusterceph --name client.rgw.node1 --setuser ceph --setgroup ceph

[cep@node1 ~]$ sudo rados --id rgw.node1 --keyring 
/var/lib/ceph/radosgw/ceph-rgw.node1/keyring lspools
rbd
.rgw.root
default.rgw.control
default.rgw.data.root
default.rgw.gc
default.rgw.log
default.rgw.users.uid
default.rgw.users.keys
default.rgw.meta
default.rgw.buckets.index

I

> 在 2016年10月10日,下午2:57,Brad Hubbard  写道:
> 
> sudo rados --id rgw.ceph-rgw0 --keyring 
> /var/lib/ceph/radosgw/ceph-rgw.ceph-rgw0/keyring lspools

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Help! how to set iscsi.conf of SPDK iscsi target when using ceph rbd

2017-04-26 Thread yiming xie
I want to use the ceph rbd as storage backend of SPDK iscsi target,
but I start the iscsi_tgt failed!

I don't know how to specifiy backend storage type and some parrameters about 
ceph rbd
Please show me the example of iscsi.conf about how to use ceph rbd if you know.
Tanks! 


./app/iscsi_tgt/iscsi_tgt -c ./test/iscsi_tgt/rbd/new.conf
coredown:
lib/env_dpkg/init.c:
rc = rte_eal_init(argcount, dpdk_args);


new.conf:

[Global]
 
[iSCSI]
  # node name (not include optional part)
  # Users can optionally change this to fit their environment.
  NodeBase "iqn.2016-06.io.spdk"

  AuthFile /usr/local/etc/spdk/auth.conf

  MinConnectionsPerCore 4
 
  MinConnectionIdleInterval 5000

  # Socket I/O timeout sec. (0 is infinite)
  Timeout 30
 # authentication information for discovery session
  DiscoveryAuthMethod Auto

  #MaxSessions 128
  #MaxConnectionsPerSession 2

  # iSCSI initial parameters negotiate with initiators
  # NOTE: incorrect values might crash
  DefaultTime2Wait 2
  DefaultTime2Retain 60

  ImmediateData Yes
  ErrorRecoveryLevel 0

[Rpc]
  # Defines whether to enable configuration via RPC.
  # Default is disabled.  Note that the RPC interface is not
  # authenticated, so users should be careful about enabling
  # RPC in non-trusted environments.
  Enable No
  # Listen address for the RPC service.
  # May be an IP address or an absolute path to a Unix socket.
  Listen 127.0.0.1

[PortalGroup1]
  Portal DA1 172.16.121.131:3260


[InitiatorGroup1]
  InitiatorName ALL
  Netmask 172.16.121.0/24

[Ioat]
  Disable Yes
  Whitelist 00:04.0
  Whitelist 00:04.1

[AIO]

[Ceph]
  Ceph rbd foo 512

[TargetNode1]
  TargetName test-targetname
  TargetAlias "alias-test-targetname"
  Mapping PortalGroup1 InitiatorGroup1
  #AuthMethod Auto
  #AuthGroup AuthGroup1
  # Enable header and data digest
  # UseDigest Header Data
  #UseDigest Auto
  # Use the first malloc target
  LUN0 Ceph0
  QueueDepth 128


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Help! create the secondary zone group failed!

2017-05-03 Thread yiming xie

>I try to create two zone groups, but I have a problem.
>I do not know where there was a mistake in this process.
> 
> 1.create the firstr zone group on the c1 cluster
> ./bin/radosgw-admin -c ./run/c1/ceph.conf realm create --rgw-realm=earth 
> --default
> ./bin/radosgw-admin -c ./run/c1/ceph.conf zonegroup create --rgw-zonegroup=us 
> --endpoints=http://localhost:8001  --master --default
> 
> ./bin/radosgw-admin -c ./run/c1/ceph.conf zone create --rgw-zonegroup=us 
> --rgw-zone=us-1 --endpoints=http://localhost:8001  
> --master --default --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
> ./bin/radosgw-admin -c ./run/c1/ceph.conf user create --uid=zone.user 
> --display-name="Zone User" --access-key=$SYSTEM_ACCESS_KEY 
> --secret=$SYSTEM_SECRET_KEY --system
> ./bin/radosgw-admin -c ./run/c1/ceph.conf period update --commit
> //start rgw
> ./bin/radosgw -c ./run/c1/ceph.conf --log-file=./run/c1/out/rgw.log 
> --debug-rgw=20 --debug-ms=1 -i client.rgw.us -1 
> -rgw-zone=us-1
> 
> 2.create the scondary zone group on the c2 cluster
> ./bin/radosgw-admin -c ./run/c2/ceph.conf realm pull 
> --url=http://localhost:8001  
> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
> ./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup create 
> --rgw-zonegroup=us2 --endpoints=http://localhost:8002 
>  --rgw-realm=earth
> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
> --rgw-zonegroup=us2 --rgw-realm=earth
> 
> 2017-05-03 00:51:20.190417 7f538dbbb6c0  1 Cannot find zone id= (name=), 
> switching to local zonegroup configuration
> 2017-05-03 00:51:20.192342 7f538dbbb6c0 -1 Cannot find zone id= (name=)
> couldn't init storage provider
> 
> Tks!
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Help! how to create multiple zonegroups in single realm?

2017-05-03 Thread yiming xie
Hi orit:
I try to create multiple zonegroups in single realm, but failed. Pls tell me 
the correct way about creating multiple zonegroups
Tks a lot!!

>> 1.create the firstr zone group on the c1 cluster
>> ./bin/radosgw-admin -c ./run/c1/ceph.conf realm create --rgw-realm=earth 
>> --default
>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zonegroup create 
>> --rgw-zonegroup=us --endpoints=http://localhost:8001 
>>  --master --default
>> 
>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zone create --rgw-zonegroup=us 
>> --rgw-zone=us-1 --endpoints=http://localhost:8001  
>> --master --default --access-key=$SYSTEM_ACCESS_KEY 
>> --secret=$SYSTEM_SECRET_KEY
>> ./bin/radosgw-admin -c ./run/c1/ceph.conf user create --uid=zone.user 
>> --display-name="Zone User" --access-key=$SYSTEM_ACCESS_KEY 
>> --secret=$SYSTEM_SECRET_KEY --system
>> ./bin/radosgw-admin -c ./run/c1/ceph.conf period update --commit
>> //start rgw
>> ./bin/radosgw -c ./run/c1/ceph.conf --log-file=./run/c1/out/rgw.log 
>> --debug-rgw=20 --debug-ms=1 -i client.rgw.us -1 
>> -rgw-zone=us-1
>> 
>> 2.create the scondary zone group on the c2 cluster
>> ./bin/radosgw-admin -c ./run/c2/ceph.conf realm pull 
>> --url=http://localhost:8001  
>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup create 
>> --rgw-zonegroup=us2 --endpoints=http://localhost:8002 
>>  --rgw-realm=earth
>> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
>> --rgw-zonegroup=us2 --rgw-realm=earth
>> 
>> 2017-05-03 00:51:20.190417 7f538dbbb6c0  1 Cannot find zone id= (name=), 
>> switching to local zonegroup configuration
>> 2017-05-03 00:51:20.192342 7f538dbbb6c0 -1 Cannot find zone id= (name=)
>> couldn't init storage provider
>> .
>> 
>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zone create ..
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Help! how to create multiple zonegroups in single realm?

2017-05-03 Thread yiming xie
Hi Orit:
  Thanks for your reply.

 when I recreate secondary zone group, there is still a error!

  radosgw-admin realm pull --url=http://localhost:8001 <http://localhost:8001/> 
--access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY --default
  radosgw-admin period pull --url=http://localhost:8001 
<http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
--secret=$SYSTEM_SECRET_KEY --default
  radosge-admin zonegroup create --rgw-zonegroup=us2 
--endpoints=http://localhost:8002 --rgw-realm=earth
  radosgw-admin zone create --rgw-zonegroup=us2 --rgw-zone=us-2 
--endpoints=http://localhost:8002 --master --access-key=$SYSTEM_ACCESS_KEY 
--secret=$SYSTEM_SECRET_KEY
 radosgw-admin period update --commit --rgw-zonegroup=us2 --rgw-zone=us-2

2017-05-03 04:31:57.319796 7f87dab4e6c0  1 error read_lastest_epoch 
.rgw.root:periods.894eeaf6-4c1f-4478-88eb-413e58f1a4a4:staging.latest_epoch
Sending period to new master zone cb8fd49d-9789-4cb3-8010-2523bf46a650
could not find connection for zone or zonegroup id: 
cb8fd49d-9789-4cb3-8010-2523bf46a650
request failed: (2) No such file or directory
failed to commit period: (2) No such file or directory

ceph version 11.1.0-7421-gd25b355 (d25b3550dae243f6868a526632e97405866e76d4)


  

> 在 2017年5月3日,下午4:07,Orit Wasserman  写道:
> 
> Hi,
> 
> On Wed, May 3, 2017 at 11:00 AM, yiming xie  <mailto:plato...@gmail.com>> wrote:
> Hi orit:
> I try to create multiple zonegroups in single realm, but failed. Pls tell me 
> the correct way about creating multiple zonegroups
> Tks a lot!!
> 
>>> 1.create the firstr zone group on the c1 cluster
>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf realm create --rgw-realm=earth 
>>> --default
>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zonegroup create 
>>> --rgw-zonegroup=us --endpoints=http://localhost:8001 
>>> <http://localhost:8001/> --master --default
>>> 
>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zone create --rgw-zonegroup=us 
>>> --rgw-zone=us-1 --endpoints=http://localhost:8001 <http://localhost:8001/> 
>>> --master --default --access-key=$SYSTEM_ACCESS_KEY 
>>> --secret=$SYSTEM_SECRET_KEY
>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf user create --uid=zone.user 
>>> --display-name="Zone User" --access-key=$SYSTEM_ACCESS_KEY 
>>> --secret=$SYSTEM_SECRET_KEY --system
>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf period update --commit
>>> //start rgw
>>> ./bin/radosgw -c ./run/c1/ceph.conf --log-file=./run/c1/out/rgw.log 
>>> --debug-rgw=20 --debug-ms=1 -i client.rgw.us <http://client.rgw.us/>-1 
>>> -rgw-zone=us-1
>>> 
>>> 2.create the scondary zone group on the c2 cluster
>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf realm pull 
>>> --url=http://localhost:8001 <http://localhost:8001/> 
>>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
> 
> I recommend adding --default that set this realm as default otherwise you 
> need to run:
> radosgw-admin realm default --rgw-realm=earth
> 
> You are missing the period pull command:
>  radosgw-admin period pull --url=http://localhost:8001 
> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
> --secret=$SYSTEM_SECRET_KEY --default
> 
> Orit
>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup create 
>>> --rgw-zonegroup=us2 --endpoints=http://localhost:8002 
>>> <http://localhost:8002/> --rgw-realm=earth
>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
>>> --rgw-zonegroup=us2 --rgw-realm=earth
>>> 
>>> 2017-05-03 00:51:20.190417 7f538dbbb6c0  1 Cannot find zone id= (name=), 
>>> switching to local zonegroup configuration
>>> 2017-05-03 00:51:20.192342 7f538dbbb6c0 -1 Cannot find zone id= (name=)
>>> couldn't init storage provider
>>> .
>>> 
>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zone create ..

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Help! how to create multiple zonegroups in single realm?

2017-05-03 Thread yiming xie
I run
./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit

the error:
2017-05-03 04:46:10.298103 7fdb2e4226c0  1 Cannot find zone 
id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2), switching to local 
zonegroup configuration
2017-05-03 04:46:10.300145 7fdb2e4226c0 -1 Cannot find zone 
id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2)
couldn't init storage provider


> 在 2017年5月3日,下午4:45,Orit Wasserman  写道:
> 
> 
> 
> On Wed, May 3, 2017 at 11:36 AM, yiming xie  <mailto:plato...@gmail.com>> wrote:
> Hi Orit:
>   Thanks for your reply.
> 
>  when I recreate secondary zone group, there is still a error!
> 
>   radosgw-admin realm pull --url=http://localhost:8001 
> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
> --secret=$SYSTEM_SECRET_KEY --default
>   radosgw-admin period pull --url=http://localhost:8001 
> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
> --secret=$SYSTEM_SECRET_KEY --default
>   radosge-admin zonegroup create --rgw-zonegroup=us2 
> --endpoints=http://localhost:8002 <http://localhost:8002/> --rgw-realm=earth
>   radosgw-admin zone create --rgw-zonegroup=us2 --rgw-zone=us-2 
> --endpoints=http://localhost:8002 <http://localhost:8002/> --master 
> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>  radosgw-admin period update --commit --rgw-zonegroup=us2 --rgw-zone=us-2
> 
> Remove  "--rgw-zonegroup=us2 --rgw-zone=us-2" - they don't exist yet
> 
>  
> 2017-05-03 04:31:57.319796 7f87dab4e6c0  1 error read_lastest_epoch 
> .rgw.root:periods.894eeaf6-4c1f-4478-88eb-413e58f1a4a4:staging.latest_epoch
> Sending period to new master zone cb8fd49d-9789-4cb3-8010-2523bf46a650
> could not find connection for zone or zonegroup id: 
> cb8fd49d-9789-4cb3-8010-2523bf46a650
> request failed: (2) No such file or directory
> failed to commit period: (2) No such file or directory
> 
> ceph version 11.1.0-7421-gd25b355 (d25b3550dae243f6868a526632e97405866e76d4)
> 
> 
>   
> 
>> 在 2017年5月3日,下午4:07,Orit Wasserman > <mailto:owass...@redhat.com>> 写道:
>> 
>> Hi,
>> 
>> On Wed, May 3, 2017 at 11:00 AM, yiming xie > <mailto:plato...@gmail.com>> wrote:
>> Hi orit:
>> I try to create multiple zonegroups in single realm, but failed. Pls tell me 
>> the correct way about creating multiple zonegroups
>> Tks a lot!!
>> 
>>>> 1.create the firstr zone group on the c1 cluster
>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf realm create --rgw-realm=earth 
>>>> --default
>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zonegroup create 
>>>> --rgw-zonegroup=us --endpoints=http://localhost:8001 
>>>> <http://localhost:8001/> --master --default
>>>> 
>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zone create --rgw-zonegroup=us 
>>>> --rgw-zone=us-1 --endpoints=http://localhost:8001 <http://localhost:8001/> 
>>>> --master --default --access-key=$SYSTEM_ACCESS_KEY 
>>>> --secret=$SYSTEM_SECRET_KEY
>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf user create --uid=zone.user 
>>>> --display-name="Zone User" --access-key=$SYSTEM_ACCESS_KEY 
>>>> --secret=$SYSTEM_SECRET_KEY --system
>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf period update --commit
>>>> //start rgw
>>>> ./bin/radosgw -c ./run/c1/ceph.conf --log-file=./run/c1/out/rgw.log 
>>>> --debug-rgw=20 --debug-ms=1 -i client.rgw.us <http://client.rgw.us/>-1 
>>>> -rgw-zone=us-1
>>>> 
>>>> 2.create the scondary zone group on the c2 cluster
>>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf realm pull 
>>>> --url=http://localhost:8001 <http://localhost:8001/> 
>>>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>> 
>> I recommend adding --default that set this realm as default otherwise you 
>> need to run:
>> radosgw-admin realm default --rgw-realm=earth
>> 
>> You are missing the period pull command:
>>  radosgw-admin period pull --url=http://localhost:8001 
>> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
>> --secret=$SYSTEM_SECRET_KEY --default
>> 
>> Orit
>>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup create 
>>>> --rgw-zonegroup=us2 --endpoints=http://localhost:8002 
>>>> <http://localhost:8002/> --rgw-realm=earth
>>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
>>>> --rgw-zonegroup=us2 --rgw-realm=earth
>>>> 
>>>> 2017-05-03 00:51:20.190417 7f538dbbb6c0  1 Cannot find zone id= (name=), 
>>>> switching to local zonegroup configuration
>>>> 2017-05-03 00:51:20.192342 7f538dbbb6c0 -1 Cannot find zone id= (name=)
>>>> couldn't init storage provider
>>>> .
>>>> 
>>>> ./bin/radosgw-admin -c ./run/c2/ceph.conf zone create ..
> 
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Help! how to create multiple zonegroups in single realm?

2017-05-03 Thread yiming xie
 Cluster c2 have not zone:us-1

./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
--rgw-zonegroup=us --rgw-zone=us-1

2017-05-03 05:01:30.219721 7efcff2606c0  1 Cannot find zone id= (name=us-1), 
switching to local zonegroup configuration
2017-05-03 05:01:30.222956 7efcff2606c0 -1 Cannot find zone id= (name=us-1)
couldn't init storage provider

./bin/radosgw-admin -c ./run/c2/ceph.conf zone get --rgw-zone=us-1 
unable to initialize zone: (2) No such file or directory

./bin/radosgw-admin -c ./run/c2/ceph.conf zone list
{
"default_info": "0cae32e6-82d5-489f-adf5-99e92c70f86f",
"zones": [
"us-2"
]
}

./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup list
{
"default_info": "6cc7889a-3f00-4fcd-b4dd-0f5951fbd561",
"zonegroups": [
"us2",
"us"
]
}


> 在 2017年5月3日,下午4:57,Orit Wasserman  写道:
> 
> 
> 
> On Wed, May 3, 2017 at 11:51 AM, yiming xie  <mailto:plato...@gmail.com>> wrote:
> I run
> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit
> 
> 
> try adding --rgw-zonegroup=us1 --rgw-zone=us-1
>  
> the error:
> 2017-05-03 04:46:10.298103 7fdb2e4226c0  1 Cannot find zone 
> id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2), switching to local 
> zonegroup configuration
> 2017-05-03 04:46:10.300145 7fdb2e4226c0 -1 Cannot find zone 
> id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2)
> couldn't init storage provider
> 
> 
>> 在 2017年5月3日,下午4:45,Orit Wasserman > <mailto:owass...@redhat.com>> 写道:
>> 
>> 
>> 
>> On Wed, May 3, 2017 at 11:36 AM, yiming xie > <mailto:plato...@gmail.com>> wrote:
>> Hi Orit:
>>   Thanks for your reply.
>> 
>>  when I recreate secondary zone group, there is still a error!
>> 
>>   radosgw-admin realm pull --url=http://localhost:8001 
>> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
>> --secret=$SYSTEM_SECRET_KEY --default
>>   radosgw-admin period pull --url=http://localhost:8001 
>> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
>> --secret=$SYSTEM_SECRET_KEY --default
>>   radosge-admin zonegroup create --rgw-zonegroup=us2 
>> --endpoints=http://localhost:8002 <http://localhost:8002/> --rgw-realm=earth
>>   radosgw-admin zone create --rgw-zonegroup=us2 --rgw-zone=us-2 
>> --endpoints=http://localhost:8002 <http://localhost:8002/> --master 
>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>>  radosgw-admin period update --commit --rgw-zonegroup=us2 --rgw-zone=us-2
>> 
>> Remove  "--rgw-zonegroup=us2 --rgw-zone=us-2" - they don't exist yet
>> 
>>  
>> 2017-05-03 04:31:57.319796 7f87dab4e6c0  1 error read_lastest_epoch 
>> .rgw.root:periods.894eeaf6-4c1f-4478-88eb-413e58f1a4a4:staging.latest_epoch
>> Sending period to new master zone cb8fd49d-9789-4cb3-8010-2523bf46a650
>> could not find connection for zone or zonegroup id: 
>> cb8fd49d-9789-4cb3-8010-2523bf46a650
>> request failed: (2) No such file or directory
>> failed to commit period: (2) No such file or directory
>> 
>> ceph version 11.1.0-7421-gd25b355 (d25b3550dae243f6868a526632e97405866e76d4)
>> 
>> 
>>   
>> 
>>> 在 2017年5月3日,下午4:07,Orit Wasserman >> <mailto:owass...@redhat.com>> 写道:
>>> 
>>> Hi,
>>> 
>>> On Wed, May 3, 2017 at 11:00 AM, yiming xie >> <mailto:plato...@gmail.com>> wrote:
>>> Hi orit:
>>> I try to create multiple zonegroups in single realm, but failed. Pls tell 
>>> me the correct way about creating multiple zonegroups
>>> Tks a lot!!
>>> 
>>>>> 1.create the firstr zone group on the c1 cluster
>>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf realm create --rgw-realm=earth 
>>>>> --default
>>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zonegroup create 
>>>>> --rgw-zonegroup=us --endpoints=http://localhost:8001 
>>>>> <http://localhost:8001/> --master --default
>>>>> 
>>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf zone create --rgw-zonegroup=us 
>>>>> --rgw-zone=us-1 --endpoints=http://localhost:8001 
>>>>> <http://localhost:8001/> --master --default 
>>>>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>>>>> ./bin/radosgw-admin -c ./run/c1/ceph.conf user create --uid=zone.user 
>>>>> --display-name="Zone User" --access-key=$SYSTEM_ACCESS_KEY 
>>>>> --secret=$SYSTEM_SECRET_KEY --syst

Re: [ceph-users] Help! how to create multiple zonegroups in single realm?

2017-05-03 Thread yiming xie
./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
--rgw-zonegroup=default --rgw-zone=default
2017-05-03 05:34:23.886966 7f9e6e0036c0  0 failed reading zonegroup info: ret 
-2 (2) No such file or directory
couldn't init storage provider

I will commit this issue.
 Thanks for your advice!

> 在 2017年5月3日,下午5:13,Orit Wasserman  写道:
> 
> 
> 
> On Wed, May 3, 2017 at 12:05 PM, yiming xie  <mailto:plato...@gmail.com>> wrote:
>  Cluster c2 have not zone:us-1
> 
> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit 
> --rgw-zonegroup=us --rgw-zone=us-1
> 
> try --rgw-zonegroup==default --rgw-zone=default.
> 
> Could you open a tracker (tracker.ceph.com <http://tracker.ceph.com/>) issue 
> about this ,include all the configuration and all the commands you tried.
> it should have worked without parameters or with just zone us-2.
> 
> Orit
> 
> 
> 2017-05-03 05:01:30.219721 7efcff2606c0  1 Cannot find zone id= (name=us-1), 
> switching to local zonegroup configuration
> 2017-05-03 05:01:30.222956 7efcff2606c0 -1 Cannot find zone id= (name=us-1)
> couldn't init storage provider
> 
> ./bin/radosgw-admin -c ./run/c2/ceph.conf zone get --rgw-zone=us-1 
> unable to initialize zone: (2) No such file or directory
> 
> ./bin/radosgw-admin -c ./run/c2/ceph.conf zone list
> {
> "default_info": "0cae32e6-82d5-489f-adf5-99e92c70f86f",
> "zones": [
> "us-2"
> ]
> }
> 
> ./bin/radosgw-admin -c ./run/c2/ceph.conf zonegroup list
> {
> "default_info": "6cc7889a-3f00-4fcd-b4dd-0f5951fbd561",
> "zonegroups": [
> "us2",
> "us"
> ]
> }
> 
> 
>> 在 2017年5月3日,下午4:57,Orit Wasserman > <mailto:owass...@redhat.com>> 写道:
>> 
>> 
>> 
>> On Wed, May 3, 2017 at 11:51 AM, yiming xie > <mailto:plato...@gmail.com>> wrote:
>> I run
>> ./bin/radosgw-admin -c ./run/c2/ceph.conf period update --commit
>> 
>> 
>> try adding --rgw-zonegroup=us1 --rgw-zone=us-1
>>  
>> the error:
>> 2017-05-03 04:46:10.298103 7fdb2e4226c0  1 Cannot find zone 
>> id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2), switching to local 
>> zonegroup configuration
>> 2017-05-03 04:46:10.300145 7fdb2e4226c0 -1 Cannot find zone 
>> id=0cae32e6-82d5-489f-adf5-99e92c70f86f (name=us-2)
>> couldn't init storage provider
>> 
>> 
>>> 在 2017年5月3日,下午4:45,Orit Wasserman >> <mailto:owass...@redhat.com>> 写道:
>>> 
>>> 
>>> 
>>> On Wed, May 3, 2017 at 11:36 AM, yiming xie >> <mailto:plato...@gmail.com>> wrote:
>>> Hi Orit:
>>>   Thanks for your reply.
>>> 
>>>  when I recreate secondary zone group, there is still a error!
>>> 
>>>   radosgw-admin realm pull --url=http://localhost:8001 
>>> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
>>> --secret=$SYSTEM_SECRET_KEY --default
>>>   radosgw-admin period pull --url=http://localhost:8001 
>>> <http://localhost:8001/> --access-key=$SYSTEM_ACCESS_KEY 
>>> --secret=$SYSTEM_SECRET_KEY --default
>>>   radosge-admin zonegroup create --rgw-zonegroup=us2 
>>> --endpoints=http://localhost:8002 <http://localhost:8002/> --rgw-realm=earth
>>>   radosgw-admin zone create --rgw-zonegroup=us2 --rgw-zone=us-2 
>>> --endpoints=http://localhost:8002 <http://localhost:8002/> --master 
>>> --access-key=$SYSTEM_ACCESS_KEY --secret=$SYSTEM_SECRET_KEY
>>>  radosgw-admin period update --commit --rgw-zonegroup=us2 --rgw-zone=us-2
>>> 
>>> Remove  "--rgw-zonegroup=us2 --rgw-zone=us-2" - they don't exist yet
>>> 
>>>  
>>> 2017-05-03 04:31:57.319796 7f87dab4e6c0  1 error read_lastest_epoch 
>>> .rgw.root:periods.894eeaf6-4c1f-4478-88eb-413e58f1a4a4:staging.latest_epoch
>>> Sending period to new master zone cb8fd49d-9789-4cb3-8010-2523bf46a650
>>> could not find connection for zone or zonegroup id: 
>>> cb8fd49d-9789-4cb3-8010-2523bf46a650
>>> request failed: (2) No such file or directory
>>> failed to commit period: (2) No such file or directory
>>> 
>>> ceph version 11.1.0-7421-gd25b355 (d25b3550dae243f6868a526632e97405866e76d4)
>>> 
>>> 
>>>   
>>> 
>>>> 在 2017年5月3日,下午4:07,Orit Wasserman >>> <mailto:owass...@redhat.com>> 写道:
>>>> 
>>>> Hi,
>>>> 
>>>> On Wed, May 3, 2017 at 11:00 AM, yimin