Re: [ceph-users] radosgw can still get the object even if this object's physical file is removed on OSDs
Thanks, Yehuda, for your reply. I think you may be right because I did another experiment which seems there might be a reference to an object. I am just curious to do that for some corner case. On Tue, Oct 15, 2013 at 12:39 AM, Yehuda Sadeh wrote: > On Mon, Oct 14, 2013 at 4:04 AM, david zhang > wrote: > > Hi ceph-users, > > > > I uploaded an object successfully to radosgw with 3 replicas. And I > located > > all the physical paths of 3 replicas on different OSDs. > > > > i.e, one of the 3 physical paths is > > > /var/lib/ceph/osd/ceph-2/current/3.5_head/DIR_D/default.4896.65\\u20131014\\u1__head_0646563D__3 > > > > Then I manually deleted all the 3 replica files on OSDs, but this object > can > > still get from radosgw with http code 200 even I cleaned all the caches > on > > both radosgw and OSDs by 'echo 3 > /proc/sys/vm/drop_caches'. Only after > I > > restarted the 3 OSDs, get request will return 404. > > > > What did I miss? Is it not right to clean cache in that way? > > I'm not too sure what you're trying to achieve. You should never ever > access the osd objects directly like that. The reason you're still > able to read the objects is probably because the osd keeps open fds > for recently opened files and it still holds a reference to them. If > you need to remove objects off the rados backend you should use the > rados tool to do that. However, since you created the objects via > radosgw, you're going to have some radosgw consistency issues, so in > that case the way to go would be by going through radosgw-admin (or > through the radosgw RESTful api). > > > Yehuda > -- Regards, Zhi ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] how to usr libcephfs.jar(the cephfs java interface)
|
Hi all;
I want to test java Interface, and I make the ceph by ./configure
--enadble-cephfs-java make make install.
the resurt is libcephfs.jar lie in /ceph/src/java and libcephfs_jin.so lie in
/usr/local/lib.
so, I cord the java file vim Test.java
package com.ceph.fs;
import com.ceph.crush.Bucket;
public class Test {
public static void main (String [] args){
CephMount mount = new Ceph CephMount();
mount.conf_read_file("/etc/ceph/ceph.conf");
}
}
and when I build it !
# javac -classpath ../libcephfs.jar com/ceph/fs/Test.java
com/ceph/fs/Test:9:unreported exception java.io.FileNotFoundException;
must be caught or declared to be throw
mount.conf_read_file("/ect/ceph/ceph.conf");
^
error 1.
Thanks vary much!
pengft
|
|
| | |
|___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Ceph, Keystone and S3
Hi
I've deployed Ceph using Ceph-deploy and following the official
documentation. I've created a user to use with Swift and everything is
working fine, my users can create buckets and upload files if they use
Horizon Dashboard or Swift CLI.
However, everything changes if they try to do it with S3 API. When they
download their credentials from Horizon dashboard to get their keys, they
can't connect to ceph using S3 API. They only get a "403 Access Denied"
error message. I'm using Ceph 0.70 so, if i'm not wrong, ceph should be
able to validate S3 tokens against keystone since 0.69 version.
Here is my ceph.conf:
[client.radosgw.gateway]
host = server2
keyring = /etc/ceph/keyring.radosgw.gateway
rgw socket path = /var/run/ceph/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw keystone url = server4:35357
rgw keystone admin token = admintoken
rgw keystone accepted roles = admin _member_ Member
rgw print continue = false
rgw keystone token cache size = 500
rgw keystone revocation interval = 500
nss db path = /var/ceph/nss
#Add DNS hostname to enable S3 subdomain calls
rgw dns name = server2
And this is the error message (with s3-curl):
> GET / HTTP/1.1
> User-Agent: curl/7.29.0
> Host: host_ip
> Accept: */*
> Date: Tue, 15 Oct 2013 14:07:24 +
> Authorization: AWS
3a1ecdea87d6493a9922c13a06d392cf:SNu/sjTuDtvunOQKJaU8Besm1RQ=
>
< HTTP/1.1 403 Forbidden
< Date: Tue, 15 Oct 2013 14:07:24 GMT
< Server: Apache/2.2.22 (Ubuntu)
< Accept-Ranges: bytes
< Content-Length: 78
< Content-Type: application/xml
<
{ [data not shown]
AccessDenied
Regards
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] how to usr libcephfs.jar(the cephfs java interface)
On Tue, Oct 15, 2013 at 2:13 AM, 鹏 wrote:
>
> *** # javac -classpath ../libcephfs.jar com/ceph/fs/Test.java
> com/ceph/fs/Test:9:unreported exception java.io.FileNotFoundException;
> must be caught or declared to be throw
> mount.conf_read_file("/ect/ceph/ceph.conf");
> ^
> *You will need to catch that exception, or use the `throws` keyword to
> show that the error will propogate to the caller.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> **
> **
>
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] ceph-deploy zap disk failure
Hi ceph-users, I am trying with the new ceph-deploy utility on RHEL6.4 and I came across a new issue: -bash-4.1$ ceph-deploy --version 1.2.7 -bash-4.1$ ceph-deploy disk zap server:/dev/sdb [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy disk zap server:/dev/sdb [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on server [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] detect platform information from remote host [ceph_deploy.osd][INFO ] Distro info: Red Hat Enterprise Linux Server 6.4 Santiago [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] zeroing last few blocks of device [osd2.ceph.mobstor.bf1.yahoo.com][INFO ] Running command: sudo sgdisk --zap-all --clear --mbrtogpt -- /dev/sdb [osd2.ceph.mobstor.bf1.yahoo.com][ERROR ] sudo: sgdisk: command not found While I run disk zap on the host directly, it can work without issues. Anyone meet the same issue? Thanks, Guang___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] ceph-deploy zap disk failure
On Tue, Oct 15, 2013 at 10:52 AM, Guang wrote: > Hi ceph-users, > I am trying with the new ceph-deploy utility on RHEL6.4 and I came across a > new issue: > > -bash-4.1$ ceph-deploy --version > 1.2.7 > -bash-4.1$ ceph-deploy disk zap server:/dev/sdb > [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy disk zap > server:/dev/sdb > [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on server > [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] detect platform information from > remote host > [ceph_deploy.osd][INFO ] Distro info: Red Hat Enterprise Linux Server 6.4 > Santiago > [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] zeroing last few blocks of device > [osd2.ceph.mobstor.bf1.yahoo.com][INFO ] Running command: sudo sgdisk > --zap-all --clear --mbrtogpt -- /dev/sdb > [osd2.ceph.mobstor.bf1.yahoo.com][ERROR ] sudo: sgdisk: command not found > > While I run disk zap on the host directly, it can work without issues. > Anyone meet the same issue? Can you run `which sgdisk` on that host? I want to make sure this is not a $PATH problem. ceph-deploy tries to use the proper path remotely but it could be that this one is not there. > > Thanks, > Guang > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] ceph-deploy zap disk failure
On 15 October 2013 15:52, Guang wrote: > [osd2.ceph.mobstor.bf1.yahoo.com][ERROR ] sudo: sgdisk: command not found A complete guess, but this could be due to the PATH environment not being set correctly for whatever user ceph-deploy logs into the machine as. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] radosgw-admin doesn't list user anymore
Hi Derek, Thanks. Is the 'radosgw-admin metadata list user' also available as REST API? Cheers, Valery On 15/10/13 03:21 , Derek Yarnell wrote: root@ineri:~# radosgw-admin user info could not fetch user info: no user info saved Hi Valery, You need to use radosgw-admin metadata list user Thanks, derek -- SWITCH -- Valery Tschopp, Software Engineer, Peta Solutions Werdstrasse 2, P.O. Box, 8021 Zurich, Switzerland email: valery.tsch...@switch.ch phone: +41 44 268 1544 smime.p7s Description: S/MIME Cryptographic Signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph, Keystone and S3
On Tue, Oct 15, 2013 at 7:17 AM, Carlos Gimeno Yañez wrote:
> Hi
>
> I've deployed Ceph using Ceph-deploy and following the official
> documentation. I've created a user to use with Swift and everything is
> working fine, my users can create buckets and upload files if they use
> Horizon Dashboard or Swift CLI.
>
> However, everything changes if they try to do it with S3 API. When they
> download their credentials from Horizon dashboard to get their keys, they
> can't connect to ceph using S3 API. They only get a "403 Access Denied"
> error message. I'm using Ceph 0.70 so, if i'm not wrong, ceph should be able
> to validate S3 tokens against keystone since 0.69 version.
>
> Here is my ceph.conf:
>
> [client.radosgw.gateway]
> host = server2
> keyring = /etc/ceph/keyring.radosgw.gateway
> rgw socket path = /var/run/ceph/radosgw.sock
> log file = /var/log/ceph/radosgw.log
> rgw keystone url = server4:35357
> rgw keystone admin token = admintoken
> rgw keystone accepted roles = admin _member_ Member
> rgw print continue = false
> rgw keystone token cache size = 500
> rgw keystone revocation interval = 500
> nss db path = /var/ceph/nss
>
> #Add DNS hostname to enable S3 subdomain calls
> rgw dns name = server2
>
>
> And this is the error message (with s3-curl):
>
>
>> GET / HTTP/1.1
>> User-Agent: curl/7.29.0
>> Host: host_ip
>> Accept: */*
>> Date: Tue, 15 Oct 2013 14:07:24 +
>> Authorization: AWS
>> 3a1ecdea87d6493a9922c13a06d392cf:SNu/sjTuDtvunOQKJaU8Besm1RQ=
>>
> < HTTP/1.1 403 Forbidden
> < Date: Tue, 15 Oct 2013 14:07:24 GMT
> < Server: Apache/2.2.22 (Ubuntu)
> < Accept-Ranges: bytes
> < Content-Length: 78
> < Content-Type: application/xml
> <
> { [data not shown]
>
>
> AccessDenied
>
>
> Regards
Try adding:
rgw s3 auth use keystone = true
to your ceph.conf
Yehuda
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph, Keystone and S3
Thank you very much Yehuda, that was the missing piece of my puzzle!
I think that this should be added to the official documentation.
Regards
2013/10/15 Yehuda Sadeh
> On Tue, Oct 15, 2013 at 7:17 AM, Carlos Gimeno Yañez
> wrote:
> > Hi
> >
> > I've deployed Ceph using Ceph-deploy and following the official
> > documentation. I've created a user to use with Swift and everything is
> > working fine, my users can create buckets and upload files if they use
> > Horizon Dashboard or Swift CLI.
> >
> > However, everything changes if they try to do it with S3 API. When they
> > download their credentials from Horizon dashboard to get their keys, they
> > can't connect to ceph using S3 API. They only get a "403 Access Denied"
> > error message. I'm using Ceph 0.70 so, if i'm not wrong, ceph should be
> able
> > to validate S3 tokens against keystone since 0.69 version.
> >
> > Here is my ceph.conf:
> >
> > [client.radosgw.gateway]
> > host = server2
> > keyring = /etc/ceph/keyring.radosgw.gateway
> > rgw socket path = /var/run/ceph/radosgw.sock
> > log file = /var/log/ceph/radosgw.log
> > rgw keystone url = server4:35357
> > rgw keystone admin token = admintoken
> > rgw keystone accepted roles = admin _member_ Member
> > rgw print continue = false
> > rgw keystone token cache size = 500
> > rgw keystone revocation interval = 500
> > nss db path = /var/ceph/nss
> >
> > #Add DNS hostname to enable S3 subdomain calls
> > rgw dns name = server2
> >
> >
> > And this is the error message (with s3-curl):
> >
> >
> >> GET / HTTP/1.1
> >> User-Agent: curl/7.29.0
> >> Host: host_ip
> >> Accept: */*
> >> Date: Tue, 15 Oct 2013 14:07:24 +
> >> Authorization: AWS
> >> 3a1ecdea87d6493a9922c13a06d392cf:SNu/sjTuDtvunOQKJaU8Besm1RQ=
> >>
> > < HTTP/1.1 403 Forbidden
> > < Date: Tue, 15 Oct 2013 14:07:24 GMT
> > < Server: Apache/2.2.22 (Ubuntu)
> > < Accept-Ranges: bytes
> > < Content-Length: 78
> > < Content-Type: application/xml
> > <
> > { [data not shown]
> >
> >
> > AccessDenied
> >
> >
> > Regards
>
>
> Try adding:
>
> rgw s3 auth use keystone = true
>
> to your ceph.conf
>
>
> Yehuda
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] radosgw-admin doesn't list user anymore
On 10/15/13 12:00 PM, Valery Tschopp wrote:
> Hi Derek,
>
> Thanks. Is the 'radosgw-admin metadata list user' also available as REST
> API?
Hi Valery,
Yes, it is. Not well documented I believe right now. I have this
tested and working in my python bindings[1] for the radosgw (get_users).
You will need at least --caps='metadata=read' (might need *).
/{admin}/metadata/user?format=json
[1] - https://github.com/dyarnell/rgwadmin
Thanks,
derek
--
---
Derek T. Yarnell
University of Maryland
Institute for Advanced Computer Studies
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] how to usr libcephfs.jar(the cephfs java interface)
The function conf_read_file() throws an FileNotFoundException (see
source ceph/src/java/com/ceph/fs/CephMount.java)
This exception must be caught or the function calling it has to also
throw the same exception.
Here's a slightly different version of you code that compiles in my sandbox:
package com.ceph.fs;
import java.io.FileNotFoundException;
public class Test{
public static void main(String[] args) {
CephMount mount;
try{
mount = new CephMount();
mount.conf_read_file("/etc/ceph/ceph.conf");
mount.mount("/");
} catch( Exception e ) {
System.out.println("Caught exception " + e.toString());
}
}
}
On 10/15/2013 02:13 AM, ? wrote:
Hi all;
I want to test java Interface, and I make the ceph by
./configure --enadble-cephfs-java make make install.
the resurt is libcephfs.jar lie in /ceph/src/java and libcephfs_jin.so
lie in /usr/local/lib.
so, I cord the java file vim Test.java
/package com.ceph.fs;
&nbs p; import com.ceph.crush.Bucket;
public class Test {
public static void main (String [] args){
CephMount mount = new Ceph CephMount();
mount.conf_read_file("/etc/ceph/ceph.conf");
}
}/
and when I build it !
/ # javac -classpath ../libcephfs.jar com/ceph/fs/Test.java
com/ceph/fs/Test:9:unreported exception java.io.FileNotFoundException;
must be caught or declared to be throw
mount.conf_read_file("/ect/ceph/ceph.conf");
^
error 1./
Thanks vary much!
pengft
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Is there a way to query RBD usage
I.e., can we see what the actual allocated/touched size of an RBD is in relation to its provisioned size? -- Cheers, ~Blairo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] ceph-deploy zap disk failure
-bash-4.1$ which sgdisk /usr/sbin/sgdisk Which path does ceph-deploy use? Thanks, Guang On Oct 15, 2013, at 11:15 PM, Alfredo Deza wrote: > On Tue, Oct 15, 2013 at 10:52 AM, Guang wrote: >> Hi ceph-users, >> I am trying with the new ceph-deploy utility on RHEL6.4 and I came across a >> new issue: >> >> -bash-4.1$ ceph-deploy --version >> 1.2.7 >> -bash-4.1$ ceph-deploy disk zap server:/dev/sdb >> [ceph_deploy.cli][INFO ] Invoked (1.2.7): /usr/bin/ceph-deploy disk zap >> server:/dev/sdb >> [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on server >> [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] detect platform information from >> remote host >> [ceph_deploy.osd][INFO ] Distro info: Red Hat Enterprise Linux Server 6.4 >> Santiago >> [osd2.ceph.mobstor.bf1.yahoo.com][DEBUG ] zeroing last few blocks of device >> [osd2.ceph.mobstor.bf1.yahoo.com][INFO ] Running command: sudo sgdisk >> --zap-all --clear --mbrtogpt -- /dev/sdb >> [osd2.ceph.mobstor.bf1.yahoo.com][ERROR ] sudo: sgdisk: command not found >> >> While I run disk zap on the host directly, it can work without issues. >> Anyone meet the same issue? > > Can you run `which sgdisk` on that host? I want to make sure this is > not a $PATH problem. > > ceph-deploy tries to use the proper path remotely but it could be that > this one is not there. > > >> >> Thanks, >> Guang >> >> ___ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Missing Dependency for ceph-deploy 1.2.7
Hi, I am trying to install/upgrade to 1.2.7 but Ubuntu (Precise) is complaining about unmet dependency which seemed to be python-pushy 0.5.3 which seemed to be missing. Am I correct to assume so? Regards, Luke -- - - DISCLAIMER: This e-mail (including any attachments) is for the addressee(s) only and may contain confidential information. If you are not the intended recipient, please note that any dealing, review, distribution, printing, copying or use of this e-mail is strictly prohibited. If you have received this email in error, please notify the sender immediately and delete the original message. MIMOS Berhad is a research and development institution under the purview of the Malaysian Ministry of Science, Technology and Innovation. Opinions, conclusions and other information in this e- mail that do not relate to the official business of MIMOS Berhad and/or its subsidiaries shall be understood as neither given nor endorsed by MIMOS Berhad and/or its subsidiaries and neither MIMOS Berhad nor its subsidiaries accepts responsibility for the same. All liability arising from or in connection with computer viruses and/or corrupted e-mails is excluded to the fullest extent permitted by law. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Is there a way to query RBD usage
On 10/16/2013 03:15 AM, Blair Bethwaite wrote: I.e., can we see what the actual allocated/touched size of an RBD is in relation to its provisioned size? No, not an easy way. The only way would be to probe which RADOS objects exist, but that's a heavy operation you don't want to do with large images or with a large number of RBD images. So technically it's possible, but not easy and cheap. -- Cheers, ~Blairo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Is there a way to query RBD usage
On 16/10/13 15:53, Wido den Hollander wrote: On 10/16/2013 03:15 AM, Blair Bethwaite wrote: I.e., can we see what the actual allocated/touched size of an RBD is in relation to its provisioned size? No, not an easy way. The only way would be to probe which RADOS objects exist, but that's a heavy operation you don't want to do with large images or with a large number of RBD images. So maybe a 'df' arg for rbd would be a nice addition to blueprints? Regards Mark ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Missing Dependency for ceph-deploy 1.2.7
On 10/15/13 7:54 PM, "Luke Jing Yuan" wrote: >Hi, > >I am trying to install/upgrade to 1.2.7 but Ubuntu (Precise) is >complaining about unmet dependency which seemed to be python-pushy 0.5.3 >which seemed to be missing. Am I correct to assume so? Yes - we've removed that dependency upon pushy and are in the process of testing the refactored code. The next release of ceph-deploy will no longer be dependent upon pushy. > >Regards, >Luke > >-- >- >- >DISCLAIMER: > >This e-mail (including any attachments) is for the addressee(s) >only and may contain confidential information. If you are not the >intended recipient, please note that any dealing, review, >distribution, printing, copying or use of this e-mail is strictly >prohibited. If you have received this email in error, please notify >the sender immediately and delete the original message. >MIMOS Berhad is a research and development institution under >the purview of the Malaysian Ministry of Science, Technology and >Innovation. Opinions, conclusions and other information in this e- >mail that do not relate to the official business of MIMOS Berhad >and/or its subsidiaries shall be understood as neither given nor >endorsed by MIMOS Berhad and/or its subsidiaries and neither >MIMOS Berhad nor its subsidiaries accepts responsibility for the >same. All liability arising from or in connection with computer >viruses and/or corrupted e-mails is excluded to the fullest extent >permitted by law. > > >___ >ceph-users mailing list >ceph-users@lists.ceph.com >http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Is there a way to query RBD usage
> Date: Wed, 16 Oct 2013 16:06:49 +1300 > From: Mark Kirkwood > To: Wido den Hollander , ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Is there a way to query RBD usage > Message-ID: <525e02c9.9050...@catalyst.net.nz> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > On 16/10/13 15:53, Wido den Hollander wrote: > > On 10/16/2013 03:15 AM, Blair Bethwaite wrote: > >> I.e., can we see what the actual allocated/touched size of an RBD is in > >> relation to its provisioned size? > >> > > > > No, not an easy way. The only way would be to probe which RADOS > > objects exist, but that's a heavy operation you don't want to do with > > large images or with a large number of RBD images. > > > > So maybe a 'df' arg for rbd would be a nice addition to blueprints? Yes, I think so. It does seem a little conflicting to promote Ceph as doing thin-provisioned volumes, but then not actually be able to interrogate their real usage against the provisioned size. As a cloud admin using Ceph as my block-storage layer I really want to be able to look at several metrics in relation to volumes and tenants: total GB quota, GB provisioned (i.e., total size of volumes&snaps), GB allocated When users come crying for more quota I need to whether they're making efficient use of what they've got. This actually leads into more of a conversation around the quota model of dishing out storage. IMHO it would be much more preferable to do things in a more EBS oriented fashion, where we're able to see actual usage in the backend. Especially true with snapshots - users are typically dismayed that their snapshots count towards their quota for the full size of the originally provisioned volume (despite the fact the snapshot could usually be truncated/shrunk by a factor of two or more). -- Cheers, ~Blairo ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Issue of S3 API: x-amz-acl: public-read-write and authenticated-read
Hi ceph-users, I am trying S3-compatible API of ceph, but meet following issues: 1. x-amz-acl: public-read-write I upload an object with public-read-write acl. Then I can get this object directly without access key. curl -v -s http:///mybucket0/20131015_1 ... < HTTP/1.1 200 ... But I can't write or delete this object without access key. curl -v -s http://ceph7.dev.mobstor.corp.bf1.yahoo.com/mybucket0/20131015_1-XPUT -d "1234" or curl -v -s http://ceph7.dev.mobstor.corp.bf1.yahoo.com/mybucket0/20131015_1-XDELETE ... < HTTP/1.1 403 ... AccessDenied 2. x-amz-acl: authenticated-read I have created two radowgw users. I upload an object with authenticated-read acl using access key of one radowgw user. Then I can get this object using this user's access key, but I can't get this object using the other user's access key. I am not sure if I use this authenticated-read acl correctly, please correct me if I am wrong. Thanks. -- Regards, Zhi ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
