Re: [ceph-users] Question about ceph-deploy

Hi Louis, the page you mentioned originally is intended as a quick starter guide for deploying the latest Ceph LTS release and that’s its sole purpose. For specific and advanced ceph-deploy features and usage, there is a dedicated ceph-deploy site right here: http://ceph.com/ceph-deploy/docs <

Re: [ceph-users] S3CMD and Ceph

Even with those settings it doesnt work. I still get "ERROR: Access to bucket 'BUCKET' was denied' Radosgw-admin shows me as the owner of the bucket, and when i do 's3cmd ls' by itself, it lists all buckets. But when I do 's3cmd ls s3://BUCKET' it gives me denied error. On 27/11/14 19:32, I

Re: [ceph-users] S3CMD and Ceph

Hi,Ben! Do you have problems with permissions. The configuration is fully operational. 2014-11-27 11:39 GMT+03:00 Ben : > Even with those settings it doesnt work. > > I still get "ERROR: Access to bucket 'BUCKET' was denied' > > Radosgw-admin shows me as the owner of the bucket, and when i do '

Re: [ceph-users] S3CMD and Ceph

I'm not sure about permissions. How do I check? On 27/11/14 19:41, Irek Fasikhov wrote: Hi,Ben! Do you have problems with permissions. The configuration is fully operational. 2014-11-27 11:39 GMT+03:00 Ben >: Even with those settings it doesnt work. I st

Re: [ceph-users] S3CMD and Ceph

I like this work. [rbd@rbdbackup ~]$ cat .s3cfg [default] access_key = 2M4PRTYOGI3AXBZFAXFR secret_key = LQYFttxRn+7bBJ5rD1Y7ckZCN8XjEInOFY3s9RUR host_base = s3.X.ru host_bucket = %(bucket)s.s3.X.ru enable_multipart = True multipart_chunk_size_mb = 30 use_https = True 2014-11-27 7:43 GMT+

Re: [ceph-users] Quetions abount osd journal configuration

I would like to extend my sincerest thanks and appreciation to those patient souls who helped me! I will try to tune ceph and kernel vm dirty buffer to see the effect follow your tips. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.c

[ceph-users] export from Amazon S3 -> Ceph

Any advice on the best way to export from Amazon S3 to a local ceph storage system?The data in question we'd still access via the S3 interface access to ceph. -G -- Geoff Galitz, ggal...@shutterstock.com Shutterstock GmbH Infastructure Engineering Schönhauser Allee 36, 10435 Berlin, Germa

Re: [ceph-users] export from Amazon S3 -> Ceph

There are two changes to s3cmd that are proposed to add Ceph support: https://github.com/s3tools/s3cmd/pull/391 and https://github.com/s3tools/s3cmd/pull/416 We forked s3cmd and merged 391: https://github.com/deis/s3cmd And our backup/restore documentation uses s3cmd to backup/restore the radosgw

Re: [ceph-users] Tip of the week: don't use Intel 530 SSD's for journals

Mark, if it is not too much trouble for you, could you please check the wear level and the amount of writes done on your Intel 520 ssds? It would be useful to check if they are at similar level of wear/writes as mine. I am feeling a bit sceptical that my ssds have done 6 times the guaranteed a

Re: [ceph-users] Optimal or recommended threads values

Hi Craig, Are you keeping the filestore, disk and op threads at their default values? or did you also change them? Cheers > Tuning these values depends on a lot more than just the SSDs and > HDDs. Which kernel and IO scheduler are you using? Does your HBA do > write caching? It also depends

Re: [ceph-users] Question about ceph-deploy

Ok，but the when i install ceph-deploy, it can specify the version of ceph, so i choose giant, but after i install ceph, the version is justfirefly, So it seems that the quick start mislead about the version。 On Nov 27, 2014, at 16:08, Jean-Charles LOPEZ wrote: > Hi Louis, > > the page you men

[ceph-users] Pass custom cluster name to SysVinit script on system startup?

How do you start up the SysVinit script with a cluster name? /etc/init.d/ceph (--cluster XXX <--how to you pass this for a normal system reboot; i.e. not run from command line) On a reboot, somehow the OSD manages to come up but the mon fails (no --cluster on the command line).. http://tra

Re: [ceph-users] Giant upgrade - stability issues

Sam, I've done more network testing, this time over 2 days and I believe I have enough evidence to conclude that the osd disconnects are not caused by the network. I have ran about 140 million TCP connects on each osd and host server over the course of about two days. Generating about 800-900

Re: [ceph-users] export from Amazon S3 -> Ceph

Hi Geoff, The obsync tool that ships with Ceph or Ceph-extras that does a per bucket copy of the data from S3 to the RGW using S3. Have a look at http://ceph.com/docs/argonaut/man/1/obsync/ Cheers JC > On Nov 27, 2014, at 01:40, Geoff Galitz w

[ceph-users] large reads become 512 byte reads on qemu-kvm rbd

Hi all, We throttle (with qemu-kvm) rbd devices to 100 w/s and 100 r/s (and 80MB/s write and read). With fio we cannot exceed 51.2MB/s sequential or random reads, no matter the reading block size. (But with large writes we can achieve 80MB/s). I just realised that the VM subsytem is probably sp

Re: [ceph-users] large reads become 512 kbyte reads on qemu-kvm rbd

Oops, I was off by a factor of 1000 in my original subject. We actually have 4M and 8M reads being split into 100 512kB reads per second. So perhaps these are limiting: # cat /sys/block/vdb/queue/max_sectors_kb 512 # cat /sys/block/vdb/queue/read_ahead_kb 512 Questions below remain. Cheers, Da

Re: [ceph-users] Deleting buckets and objects fails to reduce reported cluster usage

On 2014-11-27 11:36, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 3:49 PM, b wrote: On 2014-11-27 10:21, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 3:09 PM, b wrote: On 2014-11-27 09:38, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 2:32 PM, b wrote: I've been deleting a bucket which

Re: [ceph-users] S3CMD and Ceph

On 2014-11-27 19:41, Irek Fasikhov wrote: Hi,Ben! Do you have problems with permissions. The configuration is fully operational. 2014-11-27 11:39 GMT+03:00 Ben : Even with those settings it doesnt work. I still get "ERROR: Access to bucket 'BUCKET' was denied' Radosgw-admin shows me as the

Re: [ceph-users] Deleting buckets and objects fails to reduce reported cluster usage

On Thu, Nov 27, 2014 at 2:15 PM, b wrote: > On 2014-11-27 11:36, Yehuda Sadeh wrote: >> >> On Wed, Nov 26, 2014 at 3:49 PM, b wrote: >>> >>> On 2014-11-27 10:21, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 3:09 PM, b wrote: > > > On 2014-11-27 09:38, Yehuda Sadeh wrote

Re: [ceph-users] Deleting buckets and objects fails to reduce reported cluster usage

On 2014-11-28 15:42, Yehuda Sadeh wrote: On Thu, Nov 27, 2014 at 2:15 PM, b wrote: On 2014-11-27 11:36, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 3:49 PM, b wrote: On 2014-11-27 10:21, Yehuda Sadeh wrote: On Wed, Nov 26, 2014 at 3:09 PM, b wrote: On 2014-11-27 09:38, Yehuda Sadeh