I think your proxy or load balancer rewrites the requests, translates
the spaces and other special characters, which in turn clobbers the
authentication signatures. You can try disabling this functionality.
Yehuda
On Mon, Jun 2, 2014 at 3:49 PM, Andrei Mikhailovsky <and...@arhont.com> wrote:
> Yehuda,
>
> sorry for the delay in reply, I was away for a week or so.
>
> The problem happens regardless of the client. I've tried a few.
>
> You are right, I've got a load balancer and a reverse proxy behind the
> radosgw service. My setup is as follows:
>
> Internet <---> Load Balancer <--> [Apache_Proxy_Server_1 |
> Apache_Proxy_Server_2] <--> [Radosgw_Server_1 | Radosgw_Server_2]
>
> So, the client hits the Load Balancer first, which redirects traffice either
> to proxy server 1 or 2. The proxy servers connect either to radosgw server 1
> or server 2.
>
> I've noticed that if I go directly (Internet <--> Radosgw_Server_1) I do not
> have any issues with special characters.
>
> Any idea what I am missing? Perhaps something needs changing on the proxy
> server?
>
> Cheers
>
> Andrei
>
>
> ________________________________
> From: "Yehuda Sadeh" <yeh...@inktank.com>
> To: "Andrei Mikhailovsky" <and...@arhont.com>
> Cc: ceph-users@lists.ceph.com
> Sent: Wednesday, 21 May, 2014 4:24:51 PM
>
> Subject: Re: [ceph-users] Problem with radosgw and some file name characters
>
> On Tue, May 20, 2014 at 4:13 AM, Andrei Mikhailovsky <and...@arhont.com>
> wrote:
>> Anyone have any idea how to fix the problem with getting 403 when trying
>> to
>> upload files with none standard characters? I am sure I am not the only
>> one
>> with these requirements.
>
> It might be the specific client that you're using and the way it signs
> the requests. Can you try a different S3 client, see whether it works
> or not? Are you by any chance going through some kind of a load
> balancer that rewrites the urls?
>
> Yehuda
>
>> ________________________________
>> From: "Andrei Mikhailovsky" <and...@arhont.com>
>> To: "Yehuda Sadeh" <yeh...@inktank.com>
>> Cc: ceph-users@lists.ceph.com
>> Sent: Monday, 19 May, 2014 12:38:29 PM
>>
>> Subject: Re: [ceph-users] Problem with radosgw and some file name
>> characters
>>
>> Yehuda,
>>
>> Never mind my last post, i've found the issue with the rule that you've
>> suggested. my fastcgi script is called differently, so that's why i was
>> getting the 404.
>>
>> I've tried your rewrite rule and I am still having the same issues. The
>> same
>> characters are failing with the rule you've suggested.
>>
>>
>> Any idea how to fix the issue?
>>
>> Cheers
>>
>> Andrei
>> ________________________________
>> From: "Andrei Mikhailovsky" <and...@arhont.com>
>> To: "Yehuda Sadeh" <yeh...@inktank.com>
>> Cc: ceph-users@lists.ceph.com
>> Sent: Monday, 19 May, 2014 9:30:03 AM
>> Subject: Re: [ceph-users] Problem with radosgw and some file name
>> characters
>>
>> Yehuda,
>>
>> I've tried the rewrite rule that you've suggested, but it is not working
>> for
>> me. I get 404 when trying to access the service.
>>
>> RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>
>> Any idea what is wrong with this rule?
>>
>> Cheers
>>
>> Andrei
>>
>> ________________________________
>>
>>
>> From: "Yehuda Sadeh" <yeh...@inktank.com>
>> To: "Andrei Mikhailovsky" <and...@arhont.com>
>> Cc: ceph-users@lists.ceph.com
>> Sent: Friday, 16 May, 2014 5:44:52 PM
>> Subject: Re: [ceph-users] Problem with radosgw and some file name
>> characters
>>
>> Was talking about this. There is a different and simpler rule that we
>> use nowadays, for some reason it's not well documented:
>>
>> RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>
>> I still need to see a more verbose log to make a better educated guess.
>>
>> Yehuda
>>
>> On Thu, May 15, 2014 at 3:01 PM, Andrei Mikhailovsky <and...@arhont.com>
>> wrote:
>>>
>>> Yehuda,
>>>
>>> what do you mean by the rewrite rule? is this for Apache? I've used the
>>> ceph
>>> documentation to create it. My rule is:
>>>
>>>
>>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*)
>>> /s3gw.fcgi?page=$1¶ms=$2&%{QUERY_STRING}
>>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>>
>>> Or are you talking about something else?
>>>
>>> Cheers
>>>
>>> Andrei
>>> ________________________________
>>> From: "Yehuda Sadeh" <yeh...@inktank.com>
>>> To: "Andrei Mikhailovsky" <and...@arhont.com>
>>> Cc: ceph-users@lists.ceph.com
>>> Sent: Thursday, 15 May, 2014 4:05:06 PM
>>> Subject: Re: [ceph-users] Problem with radosgw and some file name
>>> characters
>>>
>>>
>>> Your rewrite rule might be off a bit. Can you provide log with 'debug rgw
>>> =
>>> 20'?
>>>
>>> Yehuda
>>>
>>> On Thu, May 15, 2014 at 8:02 AM, Andrei Mikhailovsky <and...@arhont.com>
>>> wrote:
>>>> Hello guys,
>>>>
>>>>
>>>> I am trying to figure out what is the problem here.
>>>>
>>>>
>>>> Currently running Ubuntu 12.04 with latest updates and radosgw version
>>>> 0.72.2-1precise. My ceph.conf file is pretty standard from the radosgw
>>>> howto.
>>>>
>>>>
>>>>
>>>> I am testing radosgw as a backup solution to S3 compatible clients. I am
>>>> planning to copy a large number of files/folders and I am having issues
>>>> with
>>>> a large number of files. The client reports the following error on some
>>>> files:
>>>>
>>>>
>>>> <?xml version='1.0' encoding='UTF-8'?>
>>>>
>>>> <Error>
>>>>
>>>> <Code>AccessDenied</Code>
>>>>
>>>> </Error>
>>>>
>>>>
>>>> Looking on the server backup I only see the following errors in the
>>>> radosgw.log file:
>>>>
>>>> 2014-05-13 23:50:35.786181 7f09467dc700 1 ====== starting new request
>>>> req=0x245d7e0 =====
>>>> 2014-05-13 23:50:35.786470 7f09467dc700 1 ====== req done req=0x245d7e0
>>>> http_status=403 ======
>>>>
>>>>
>>>> So, i've done a small file set comprising of test files including the
>>>> following names:
>>>>
>>>> Testing and Testing.txt
>>>> Testing ^ Testing.txt
>>>> Testing = Testing.txt
>>>> Testing _ Testing.txt
>>>> Testing - Testing.txt
>>>> Testing ; Testing.txt
>>>> Testing ! Testing.txt
>>>> Testing ? Testing.txt
>>>> Testing ( Testing.txt
>>>> Testing ) Testing.txt
>>>> Testing @ Testing.txt
>>>> Testing $ Testing.txt
>>>> Testing * Testing.txt
>>>> Testing & Testing.txt
>>>> Testing # Testing.txt
>>>> Testing % Testing.txt
>>>> Testing + Testing.txt
>>>>
>>>> From the above list the files with the following characters are giving
>>>> me
>>>> Access Denied / 403 error:
>>>>
>>>> =;()@$*&+
>>>>
>>>> The rest of the files are successfully uploaded.
>>>>
>>>> Does anyone know what is required to fix the problem?
>>>>
>>>> Many thanks
>>>>
>>>> Andrei
>>>>
>>>>
>>>> _______________________________________________
>>>> ceph-users mailing list
>>>> ceph-users@lists.ceph.com
>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>
>>>
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
