i also have this issue and there is another thread on it. radosgw-agent
will sync metadata but not data.
Do you have different gateway system user keys on master and slave zone?
On 04/24/2014 09:45 AM, lixuehui wrote:
hi,list:
I tried to sync between master zone and slave zone belong one region .
I stored a file "hello" in the bucket beast,and it returned error
,when running the radosgw-agent to sync the objects.
But metadata is OK !
the radosgw-agent reflected info that:
Thu, 24 Apr 2014 08:33:29 GMT
/admin/replica_log
DEBUG:boto:Signature:
AWS 3P2D0C0NIAL79PIQ61AC:EdSKINfImFVZjk+4/4GzkMd+woI=
DEBUG:boto:url = 'http://gw1.org/admin/replica_log?bounds'
params={'type': 'bucket-index', 'bucket-instance': u'beast:us-east.11927.1'}
headers={'Date': 'Thu, 24 Apr 2014 08:33:29 GMT', 'Content-Length': '0',
'Authorization': 'AWS 3P2D0C0NIAL79PIQ61AC:EdSKINfImFVZjk+4/4GzkMd+woI=',
'User-Agent': 'Boto/2.27.0 Python/2.7.3 Linux/3.5.0-23-generic'}
data=None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw1.org
DEBUG:requests.packages.urllib3.connectionpool:"GET
/admin/replica_log?bounds&type=bucket-index&bucket-instance=beast%3Aus-east.11927.1
HTTP/1.1" 200 None
DEBUG:boto:get_worker_bound returned: {u'marker': u'00000000002.2.3',
u'oldest_time': u'0.000000', u'markers': [{u'items_in_progress':
[{u'timestamp': u'0.000000', u'name': u'hello'}], u'position_time':
u'0.000000', u'position_marker': u'00000000002.2.3', u'entity':
u'radosgw-agent'}]}
DEBUG:boto:StringToSign:
GET
Thu, 24 Apr 2014 08:33:29 GMT
/admin/log
DEBUG:boto:Signature:
AWS V3RC1PM2TMWEBFQJEI53:Kj9gj6a59XJBJcuMZRoiTZrR5xw=
DEBUG:boto:url = 'http://gw0.org/admin/log'
params={'marker': u'00000000002.2.3', 'type': 'bucket-index',
'bucket-instance': u'beast:us-east.11927.1', 'max-entries': 1000}
headers={'Date': 'Thu, 24 Apr 2014 08:33:29 GMT', 'Content-Length': '0',
'Authorization': 'AWS V3RC1PM2TMWEBFQJEI53:Kj9gj6a59XJBJcuMZRoiTZrR5xw=',
'User-Agent': 'Boto/2.27.0 Python/2.7.3 Linux/3.5.0-23-generic'}
data=None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw0.org
DEBUG:requests.packages.urllib3.connectionpool:"GET
/admin/log?marker=00000000002.2.3&type=bucket-index&bucket-instance=beast%3Aus-east.11927.1&max-entries=1000
HTTP/1.1" 200 None
DEBUG:radosgw_agent.worker:bucket instance "beast:us-east.11927.1" has 1 entries after
"00000000002.2.3"
INFO:radosgw_agent.worker:syncing bucket "beast"
DEBUG:radosgw_agent.worker:syncing object "beast/hello"
DEBUG:radosgw_agent.worker:sync_object beast/hello
DEBUG:boto:StringToSign:
PUT
application/json; charset=UTF-8
Thu, 24 Apr 2014 08:33:29 GMT
x-amz-copy-source:beast/hello
/beast/hello
DEBUG:boto:Signature:
AWS 3P2D0C0NIAL79PIQ61AC:jfrztA4MtcPaLYVZY0kQefKLlsI=
DEBUG:boto:url = 'http://gw1.org/beast/hello'
params={'rgwx-op-id': 'kickseed:27564:1', 'rgwx-source-zone': u'us-east',
'rgwx-client-id': 'radosgw-agent'}
headers={'Content-Length': '0', 'User-Agent': 'Boto/2.27.0 Python/2.7.3
Linux/3.5.0-23-generic', 'x-amz-copy-source': 'beast/hello', 'Date': 'Thu, 24
Apr 2014 08:33:29 GMT', 'Content-Type': 'application/json; charset=UTF-8',
'Authorization': 'AWS 3P2D0C0NIAL79PIQ61AC:jfrztA4MtcPaLYVZY0kQefKLlsI='}
data=None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw1.org
DEBUG:requests.packages.urllib3.connectionpool:"PUT
/beast/hello?rgwx-op-id=kickseed%3A27564%3A1&rgwx-source-zone=us-east&rgwx-client-id=radosgw-agent
HTTP/1.1" 403 78
DEBUG:radosgw_agent.worker:exception during sync: Http error code 403 content <?xml version="1.0"
encoding="UTF-8"?><Error><Code>AccessDenied</Code></Error>
DEBUG:boto:StringToSign:
GET
Thu, 24 Apr 2014 08:33:29 GMT
/admin/opstate
DEBUG:boto:Signature:
AWS 3P2D0C0NIAL79PIQ61AC:tz+F7g6d4aABzcScTo+m26mwjW0=
DEBUG:boto:url = 'http://gw1.org/admin/opstate'
params={'client-id': 'radosgw-agent', 'object': 'beast/hello', 'op-id':
'kickseed:27564:1'}
headers={'Date': 'Thu, 24 Apr 2014 08:33:29 GMT', 'Content-Length': '0',
'Authorization': 'AWS 3P2D0C0NIAL79PIQ61AC:tz+F7g6d4aABzcScTo+m26mwjW0=',
'User-Agent': 'Boto/2.27.0 Python/2.7.3 Linux/3.5.0-23-generic'}
data=None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw1.org
DEBUG:requests.packages.urllib3.connectionpool:"GET
/admin/opstate?client-id=radosgw-agent&object=beast%2Fhello&op-id=kickseed%3A27564%3A1
HTTP/1.1" 200 None
DEBUG:radosgw_agent.worker:op state is [{u'timestamp': u'2014-04-24
08:33:31.445458Z', u'op_id': u'kickseed:27564:1', u'object': u'beast/hello',
u'state': u'error', u'client_id': u'radosgw-agent'}]
ERROR:radosgw_agent.worker:failed to sync object beast/hello: state is error
DEBUG:radosgw_agent.worker:bucket beast has 1 object
DEBUG:radosgw_agent.worker:these objects failed to be synced and will be during
the next incremental sync: [u'hello']
DEBUG:boto:set_worker_bound: data = [{'name': u'hello', 'time': '1970-01-01
00:00:00'}]
DEBUG:boto:path=/admin/replica_log?work_bound
DEBUG:boto:auth_path=/admin/replica_log?work_bound
DEBUG:boto:StringToSign:
POST
application/json; charset=UTF-8
Thu, 24 Apr 2014 08:33:29 GMT
/admin/replica_log
DEBUG:boto:Signature:
AWS 3P2D0C0NIAL79PIQ61AC:VNwRG7zsYnE4oiksYzKYArprxC4=
DEBUG:boto:url = 'http://gw1.org/admin/replica_log?work_bound'
params={'marker': u'00000000002.2.3', 'daemon_id': 'radosgw-agent', 'type':
'bucket-index', 'bucket-instance': u'beast:us-east.11927.1', 'time':
'1970-01-01 00:00:00'}
headers={'Date': 'Thu, 24 Apr 2014 08:33:29 GMT', 'Content-Length': '50',
'Content-Type': 'application/json; charset=UTF-8', 'Authorization': 'AWS
3P2D0C0NIAL79PIQ61AC:VNwRG7zsYnE4oiksYzKYArprxC4=', 'User-Agent': 'Boto/2.27.0
Python/2.7.3 Linux/3.5.0-23-generic'}
data='[{"name": "hello", "time": "1970-01-01 00:00:00"}]'
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw1.org
DEBUG:requests.packages.urllib3.connectionpool:"POST
/admin/replica_log?work_bound&marker=00000000002.2.3&daemon_id=radosgw-agent&type=bucket-index&bucket-instance=beast%3Aus-east.11927.1&time=1970-01-01+00%3A00%3A00
HTTP/1.1" 200 None
DEBUG:radosgw_agent.lock:release and clear lock
DEBUG:boto:path=/admin/log?unlock
DEBUG:boto:auth_path=/admin/log?unlock
DEBUG:boto:StringToSign:
POST
application/json; charset=UTF-8
Thu, 24 Apr 2014 08:33:29 GMT
/admin/log
DEBUG:boto:Signature:
AWS 3P2D0C0NIAL79PIQ61AC:19YhBNFZ/5lGBD+rLR/sAaJFSPY=
DEBUG:boto:url = 'http://gw1.org/admin/log?unlock'
params={'locker-id': 'kickseed:27564', 'type': 'data', 'id': 102, 'zone-id':
u'us-west'}
headers={'Date': 'Thu, 24 Apr 2014 08:33:29 GMT', 'Content-Length': '0',
'Content-Type': 'application/json; charset=UTF-8', 'Authorization': 'AWS
3P2D0C0NIAL79PIQ61AC:19YhBNFZ/5lGBD+rLR/sAaJFSPY=', 'User-Agent': 'Boto/2.27.0
Python/2.7.3 Linux/3.5.0-23-generic'}
data=None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1):
gw1.org
DEBUG:requests.packages.urllib3.connectionpool:"POST
/admin/log?unlock&locker-id=kickseed%3A27564&type=data&id=102&zone-id=us-west
HTTP/1.1" 200 None
INFO:radosgw_agent.worker:finished processing shard 102
DEBUG:radosgw_agent.sync:synced item (102, [u'beast:us-east.11927.1'])
successfully
INFO:radosgw_agent.sync:103/128 items processed
INFO:radosgw_agent.worker:27575 is processing shard number 103
DEBUG:radosgw_agent.lock:set_shard to 103
DEBUG:radosgw_agent.lock:acquire lock
DEBUG:boto:path=/admin/log?lock
DEBUG:boto:auth_path=/admin/log?lock
DEBUG:boto:StringToSign:
POST
the slave zone's radosgw log just like this:
2014-04-24 16:20:44.708279 7f1e3c7d0700 0 WARNING: couldn't find acl
header for bucket, generating default
2014-04-24 16:20:44.740256 7f1e3c7d0700 0 > HTTP_DATE -> Thu Apr 24
08:20:44 2014
2014-04-24 16:20:44.740299 7f1e3c7d0700 0 > HTTP_X_AMZ_COPY_SOURCE ->
beast/hello
2014-04-24 16:20:44.774262 7f1e3c7d0700 1 ====== req done req=0x207a010
http_status=403 ======
Thanks for any help!
------------------------------------------------------------------------
lixuehui
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
--
Systems and Storage Engineer, Digital Repository of Ireland (DRI)
High Performance & Research Computing, IS Services
Lloyd Building, Trinity College Dublin, Dublin 2, Ireland.
http://www.tchpc.tcd.ie/ | ptier...@tchpc.tcd.ie
Tel: +353-1-896-4466
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
