Yehuda,
sorry for the delay in reply, I was away for a week or so.
The problem happens regardless of the client. I've tried a few.
You are right, I've got a load balancer and a reverse proxy behind the radosgw
service. My setup is as follows:
Internet <---> Load Balancer <--> [Apache_Proxy_Server_1 |
Apache_Proxy_Server_2] <--> [Radosgw_Server_1 | Radosgw_Server_2]
So, the client hits the Load Balancer first, which redirects traffice either to
proxy server 1 or 2. The proxy servers connect either to radosgw server 1 or
server 2.
I've noticed that if I go directly (Internet <--> Radosgw_Server_1) I do not
have any issues with special characters.
Any idea what I am missing? Perhaps something needs changing on the proxy
server?
Cheers
Andrei
----- Original Message -----
From: "Yehuda Sadeh" <yeh...@inktank.com>
To: "Andrei Mikhailovsky" <and...@arhont.com>
Cc: ceph-users@lists.ceph.com
Sent: Wednesday, 21 May, 2014 4:24:51 PM
Subject: Re: [ceph-users] Problem with radosgw and some file name characters
On Tue, May 20, 2014 at 4:13 AM, Andrei Mikhailovsky <and...@arhont.com> wrote:
> Anyone have any idea how to fix the problem with getting 403 when trying to
> upload files with none standard characters? I am sure I am not the only one
> with these requirements.
It might be the specific client that you're using and the way it signs
the requests. Can you try a different S3 client, see whether it works
or not? Are you by any chance going through some kind of a load
balancer that rewrites the urls?
Yehuda
> ________________________________
> From: "Andrei Mikhailovsky" <and...@arhont.com>
> To: "Yehuda Sadeh" <yeh...@inktank.com>
> Cc: ceph-users@lists.ceph.com
> Sent: Monday, 19 May, 2014 12:38:29 PM
>
> Subject: Re: [ceph-users] Problem with radosgw and some file name characters
>
> Yehuda,
>
> Never mind my last post, i've found the issue with the rule that you've
> suggested. my fastcgi script is called differently, so that's why i was
> getting the 404.
>
> I've tried your rewrite rule and I am still having the same issues. The same
> characters are failing with the rule you've suggested.
>
>
> Any idea how to fix the issue?
>
> Cheers
>
> Andrei
> ________________________________
> From: "Andrei Mikhailovsky" <and...@arhont.com>
> To: "Yehuda Sadeh" <yeh...@inktank.com>
> Cc: ceph-users@lists.ceph.com
> Sent: Monday, 19 May, 2014 9:30:03 AM
> Subject: Re: [ceph-users] Problem with radosgw and some file name characters
>
> Yehuda,
>
> I've tried the rewrite rule that you've suggested, but it is not working for
> me. I get 404 when trying to access the service.
>
> RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>
> Any idea what is wrong with this rule?
>
> Cheers
>
> Andrei
>
> ________________________________
>
>
> From: "Yehuda Sadeh" <yeh...@inktank.com>
> To: "Andrei Mikhailovsky" <and...@arhont.com>
> Cc: ceph-users@lists.ceph.com
> Sent: Friday, 16 May, 2014 5:44:52 PM
> Subject: Re: [ceph-users] Problem with radosgw and some file name characters
>
> Was talking about this. There is a different and simpler rule that we
> use nowadays, for some reason it's not well documented:
>
> RewriteRule ^/(.*) /s3gw.3.fcgi?%{QUERY_STRING}
> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>
> I still need to see a more verbose log to make a better educated guess.
>
> Yehuda
>
> On Thu, May 15, 2014 at 3:01 PM, Andrei Mikhailovsky <and...@arhont.com>
> wrote:
>>
>> Yehuda,
>>
>> what do you mean by the rewrite rule? is this for Apache? I've used the
>> ceph
>> documentation to create it. My rule is:
>>
>>
>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*)
>> /s3gw.fcgi?page=$1¶ms=$2&%{QUERY_STRING}
>> [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>>
>> Or are you talking about something else?
>>
>> Cheers
>>
>> Andrei
>> ________________________________
>> From: "Yehuda Sadeh" <yeh...@inktank.com>
>> To: "Andrei Mikhailovsky" <and...@arhont.com>
>> Cc: ceph-users@lists.ceph.com
>> Sent: Thursday, 15 May, 2014 4:05:06 PM
>> Subject: Re: [ceph-users] Problem with radosgw and some file name
>> characters
>>
>>
>> Your rewrite rule might be off a bit. Can you provide log with 'debug rgw
>> =
>> 20'?
>>
>> Yehuda
>>
>> On Thu, May 15, 2014 at 8:02 AM, Andrei Mikhailovsky <and...@arhont.com>
>> wrote:
>>> Hello guys,
>>>
>>>
>>> I am trying to figure out what is the problem here.
>>>
>>>
>>> Currently running Ubuntu 12.04 with latest updates and radosgw version
>>> 0.72.2-1precise. My ceph.conf file is pretty standard from the radosgw
>>> howto.
>>>
>>>
>>>
>>> I am testing radosgw as a backup solution to S3 compatible clients. I am
>>> planning to copy a large number of files/folders and I am having issues
>>> with
>>> a large number of files. The client reports the following error on some
>>> files:
>>>
>>>
>>> <?xml version='1.0' encoding='UTF-8'?>
>>>
>>> <Error>
>>>
>>> <Code>AccessDenied</Code>
>>>
>>> </Error>
>>>
>>>
>>> Looking on the server backup I only see the following errors in the
>>> radosgw.log file:
>>>
>>> 2014-05-13 23:50:35.786181 7f09467dc700 1 ====== starting new request
>>> req=0x245d7e0 =====
>>> 2014-05-13 23:50:35.786470 7f09467dc700 1 ====== req done req=0x245d7e0
>>> http_status=403 ======
>>>
>>>
>>> So, i've done a small file set comprising of test files including the
>>> following names:
>>>
>>> Testing and Testing.txt
>>> Testing ^ Testing.txt
>>> Testing = Testing.txt
>>> Testing _ Testing.txt
>>> Testing - Testing.txt
>>> Testing ; Testing.txt
>>> Testing ! Testing.txt
>>> Testing ? Testing.txt
>>> Testing ( Testing.txt
>>> Testing ) Testing.txt
>>> Testing @ Testing.txt
>>> Testing $ Testing.txt
>>> Testing * Testing.txt
>>> Testing & Testing.txt
>>> Testing # Testing.txt
>>> Testing % Testing.txt
>>> Testing + Testing.txt
>>>
>>> From the above list the files with the following characters are giving me
>>> Access Denied / 403 error:
>>>
>>> =;()@$*&+
>>>
>>> The rest of the files are successfully uploaded.
>>>
>>> Does anyone know what is required to fix the problem?
>>>
>>> Many thanks
>>>
>>> Andrei
>>>
>>>
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
