[ceph-users] how to use radosgw admin ops api

2013-09-16 Thread
hi ; I'm currently trying to test the radosgw-admin which lives in http://ceph.com/docs/master/radosgw/adminops/ my user's caps is "caps" : [{"type": "usages", "perm":"*"} {"type":"users", "perm":"*"} ] then, i put a commond , curl -XGET http:/

[ceph-users] how to use radosgw admin ops api

2013-09-16 Thread
hi ; I'm currently trying to test the radosgw-admin which lives in http://ceph.com/docs/master/radosgw/adminops/ my user's caps is "caps" : [{"type": "usages", "perm":"*"} {"type":"users", "perm":"*"} ] then, i put a commond , curl -XGET http:/

[ceph-users] radosgw admin api

2013-09-16 Thread
hello i do not understand what is mean " An admin API request will be done on a URI that starts with the configurable ‘admin’ resource entry point." live in http://ceph.com/docs/master/radosgw/adminops/ , can anyone explain what should i do in my ceph ! it is mean configure the ceph.conf??

Re: [ceph-users] Rbd cp empty block

2013-09-16 Thread Chris Dunlop
On Mon, Sep 16, 2013 at 09:20:29AM +0800, 王根意 wrote: > Hi all: > > I have a 30G rbd block device as virtual machine disk, Aleady installed > ubuntu 12.04. About 1G space used. > > When I want to deploy vm, I made a "rbd cp". Then problem came, it copy 30G > data instead of 1G. And this action tak

[ceph-users] Rugged data distribution on OSDs

2013-09-16 Thread Mihály Árva-Tóth
Hello, I made some tests on 3 node Ceph cluster: upload 3 million 50 KiB object to single container. Speed and performance were okay. But data does not distributed correctly. Every node has got 2 pcs. 4 TB and 1 pc. 2 TB HDD. osd.0 41 GB (4 TB) osd.1 47 GB (4 TB) osd.3 16 GB (2 TB) osd.4 40 GB (4

[ceph-users] Sparse files copied to CephFS not sparse

2013-09-16 Thread Jens-Christian Fischer
Hi all as part of moving our OpenStack VM instance store from dedicated disks on the physical hosts to a CephFS backed by an SSD pool, we noticed that the files created on CephFS aren't sparse, even though the original files were. This is on root@s2:~# ls -lhs /var/lib/nova/instances/_base tot

[ceph-users] rbd stuck creating a block device

2013-09-16 Thread Nico Massenberg
Hi there, I have successfully setup a ceph cluster with a healthy status. When trying to create a rbd block device image I am stuck with an error which I have to ctrl+c: ceph@vl0181:~/konkluster$ rbd create imagefoo --size 5120 --pool kontrastpool 2013-09-16 10:59:06.838235 7f3bcb9eb700 0 -- 1

Re: [ceph-users] rbd stuck creating a block device

2013-09-16 Thread Wido den Hollander
On 09/16/2013 11:18 AM, Nico Massenberg wrote: Hi there, I have successfully setup a ceph cluster with a healthy status. When trying to create a rbd block device image I am stuck with an error which I have to ctrl+c: ceph@vl0181:~/konkluster$ rbd create imagefoo --size 5120 --pool kontrastpoo

Re: [ceph-users] rbd stuck creating a block device

2013-09-16 Thread Nico Massenberg
Am 16.09.2013 um 11:25 schrieb Wido den Hollander : > On 09/16/2013 11:18 AM, Nico Massenberg wrote: >> Hi there, >> >> I have successfully setup a ceph cluster with a healthy status. >> When trying to create a rbd block device image I am stuck with an error >> which I have to ctrl+c: >> >> >>

Re: [ceph-users] CORS not working

2013-09-16 Thread Pawel Stefanski
hello all! Once again sorry for delay: all dumps are in http://pastebin.com/dBnEsWpW btw. I saw second commit to dumpling http://tracker.ceph.com/issues/6078, anything more changed ? best regards! -- pawel On Fri, Sep 6, 2013 at 5:11 PM, Yehuda Sadeh wrote: > Can you provide a log that inclu

Re: [ceph-users] problem with ceph-deploy hanging

2013-09-16 Thread Alfredo Deza
On Sun, Sep 15, 2013 at 3:07 PM, Gruher, Joseph R wrote: > >>From: Gruher, Joseph R >>>From: Alfredo Deza [mailto:alfredo.d...@inktank.com] >>>On Fri, Sep 13, 2013 at 5:06 PM, Gruher, Joseph R >>> wrote: >>> root@cephtest01:~# ssh cephtest02 wget -q -O- 'https://ceph.com/git/?p=ceph.git;

Re: [ceph-users] ceph-deploy and ceph-disk cannot prepare disks

2013-09-16 Thread Alfredo Deza
On Mon, Sep 16, 2013 at 12:50 AM, Andy Schuette wrote: > First-time list poster here, and I'm pretty stumped on this one. My > problem hasn't really been discussed on the list before, so I'm hoping > that I can get this figured out since it's stopping me from learning > more about ceph. I've tried

[ceph-users] Deploy a Ceph cluster to play around with

2013-09-16 Thread Guang
Hello ceph-users, ceph-devel, Nice to meet you in the community! Today I tried to deploy a Ceph cluster to play around with the API, and during the deployment, i have a couple of questions which may need you help: 1) How many hosts do I need if I want to deploy a cluster with RadosGW (so that I

Re: [ceph-users] mds stuck in rejoin

2013-09-16 Thread Serge Slipchenko
Hi, Digging the web I have found similar symptoms http://tracker.ceph.com/issues/6087 I have found that my ceph-mds isn't updated and still is 0.67.2 that doesn't have MDS patch. After update to 0.67.3 MDS stabilized. I am terribly sorry, but I hope that my bad experience will help someone. On M

Re: [ceph-users] Sparse files copied to CephFS not sparse

2013-09-16 Thread Yan, Zheng
For cephfs, the size reported by 'ls -s' is the same as file size. see http://ceph.com/docs/next/dev/differences-from-posix/ Regards Yan, Zheng On Mon, Sep 16, 2013 at 5:12 PM, Jens-Christian Fischer wrote: > > Hi all > > as part of moving our OpenStack VM instance store from dedicated disks on

Re: [ceph-users] errors after kernel-upgrade -- Help needed

2013-09-16 Thread Markus Goldberg
Hi, i must ask once again. Is there really no help to this problem? The errors are still remaining. I can't mount the cluster anymore. All my data is gone. The error-messages are still changing every few seconds. What can i do ? Please help, Markus Am 11.09.2013 08:39, schrieb Markus Goldbe

Re: [ceph-users] Rbd cp empty block

2013-09-16 Thread Sage Weil
On Mon, 16 Sep 2013, Chris Dunlop wrote: > On Mon, Sep 16, 2013 at 09:20:29AM +0800, ??? wrote: > > Hi all: > > > > I have a 30G rbd block device as virtual machine disk, Aleady installed > > ubuntu 12.04. About 1G space used. > > > > When I want to deploy vm, I made a "rbd cp". Then problem came

Re: [ceph-users] ceph-deploy and ceph-disk cannot prepare disks

2013-09-16 Thread Sage Weil
On Sun, 15 Sep 2013, Andy Schuette wrote: > First-time list poster here, and I'm pretty stumped on this one. My > problem hasn't really been discussed on the list before, so I'm hoping > that I can get this figured out since it's stopping me from learning > more about ceph. I've tried this with the

Re: [ceph-users] ceph-deploy and ceph-disk cannot prepare disks

2013-09-16 Thread Andy Schuette
That makes perfect sense, since this is a desktop install. That will be an easy fix, thanks so much for the pointer! On Mon, Sep 16, 2013 at 8:44 AM, Sage Weil wrote: > On Sun, 15 Sep 2013, Andy Schuette wrote: >> First-time list poster here, and I'm pretty stumped on this one. My >> problem hasn

Re: [ceph-users] Sparse files copied to CephFS not sparse

2013-09-16 Thread Sage Weil
On Mon, 16 Sep 2013, Yan, Zheng wrote: > For cephfs, the size reported by 'ls -s' is the same as file size. see > http://ceph.com/docs/next/dev/differences-from-posix/ ...but the files are still in fact stored sparsely. It's just hard to tell. sage > > Regards > Yan, Zheng > > > On Mon, S

Re: [ceph-users] Sparse files copied to CephFS not sparse

2013-09-16 Thread Jens-Christian Fischer
> For cephfs, the size reported by 'ls -s' is the same as file size. see > http://ceph.com/docs/next/dev/differences-from-posix/ ah! So if I understand correctly, the files are indeed sparse on CephFS? thanks /jc ___ ceph-users mailing list ceph-users@

[ceph-users] ceph-deploy mds create fails with pipe fault

2013-09-16 Thread Athanasios Kostopoulos
Dear list (and IRC channel), first of all thanks for all the support so far. I am trying to follow the guide at http://ceph.com/docs/master/start/quick-ceph-deploy/#add-a-mds However, this step fails with a long error message (after a few minutes) Any ideas on how to fix this? Below is the paste o

Re: [ceph-users] Sparse files copied to CephFS not sparse

2013-09-16 Thread Jens-Christian Fischer
> >> For cephfs, the size reported by 'ls -s' is the same as file size. see >> http://ceph.com/docs/next/dev/differences-from-posix/ > > ...but the files are still in fact stored sparsely. It's just hard to > tell. perfect - thanks! /jc ___ ceph-use

Re: [ceph-users] xfsprogs not found in RHEL

2013-09-16 Thread sriram
ping On Thu, Sep 12, 2013 at 2:27 PM, sriram wrote: > Adding to the previous issue. I dont see any files specified in 1,2 and 3 > below. I dont have fastcgi.conf, ceph.conf or s3gw.fcgi. I have followed > everything up till that point in the wiki. Is there anything missing in the > wiki or shou

Re: [ceph-users] Rbd cp empty block

2013-09-16 Thread 王根意
But how can I use the cloned block as vm disk? 2013/9/16 Guangliang Zhao > On Mon, Sep 16, 2013 at 09:20:29AM +0800, 王根意 wrote: > > Hi all: > > > > I have a 30G rbd block device as virtual machine disk, Aleady installed > > ubuntu 12.04. About 1G space used. > > > > When I want to deploy vm, I

Re: [ceph-users] Rbd cp empty block

2013-09-16 Thread Guangliang Zhao
On Mon, Sep 16, 2013 at 09:20:29AM +0800, 王根意 wrote: > Hi all: > > I have a 30G rbd block device as virtual machine disk, Aleady installed > ubuntu 12.04. About 1G space used. > > When I want to deploy vm, I made a "rbd cp". Then problem came, it copy 30G > data instead of 1G. And this action tak

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 3:46 AM, Pawel Stefanski wrote: > hello all! > > Once again sorry for delay: > all dumps are in > http://pastebin.com/dBnEsWpW > > btw. I saw second commit to dumpling http://tracker.ceph.com/issues/6078, > anything more changed ? > best regards! I pushed an extra fix to t

Re: [ceph-users] Deploy a Ceph cluster to play around with

2013-09-16 Thread Don Talton (dotalton)
If you are just playing around, you could roll everything onto a single server. Or, if you wanted, put the MON and OSD on a single server and the radosgw on a different server. You can accomplish this in a virtual machine if you don't have all the hardware you would like to test with. > -Or

[ceph-users] puppet-cephdeploy module

2013-09-16 Thread Don Talton (dotalton)
As weird as it might seem, there is a puppet module now to automate ceph-deploy. It came about as Cisco has its own OpenStack installer platform which requires full orchestration. It might be of some use to others, so here is the link: https://github.com/dontalton/puppet-cephdeploy Donald Tal

Re: [ceph-users] CORS not working

2013-09-16 Thread Pawel Stefanski
I will try with dumpling master git build today. 16 wrz 2013 18:55, "Yehuda Sadeh" napisał(a): > On Mon, Sep 16, 2013 at 9:47 AM, Pawel Stefanski > wrote: > > ceph version 0.67.3 (408cd61584c72c0d97b774b3d8f95c6b1b06341a) > > > That one doesn't have the required fix, which will be in 0.67.4. > >

Re: [ceph-users] CORS not working

2013-09-16 Thread Pawel Stefanski
ceph version 0.67.3 (408cd61584c72c0d97b774b3d8f95c6b1b06341a) 16 wrz 2013 18:40, "Yehuda Sadeh" napisał(a): > On Mon, Sep 16, 2013 at 9:29 AM, Pawel Stefanski > wrote: > > hello! > > > > Thanks for answer! > > > > My mistake ;-), > > Correct OPTIONS request in > > http://pastebin.com/MmRtTgiZ >

[ceph-users] getting started

2013-09-16 Thread Justin Ryan
Hi, I'm brand new to Ceph, attempting to follow the Getting Startedguide with 2 VMs. I completed the Preflight without issue. I completed Storage Cluster Quick Start , but have some questions: The *Single N

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 9:47 AM, Pawel Stefanski wrote: > ceph version 0.67.3 (408cd61584c72c0d97b774b3d8f95c6b1b06341a) That one doesn't have the required fix, which will be in 0.67.4. Yehuda > > 16 wrz 2013 18:40, "Yehuda Sadeh" napisał(a): > >> On Mon, Sep 16, 2013 at 9:29 AM, Pawel Stefan

Re: [ceph-users] CORS not working

2013-09-16 Thread Pawel Stefanski
hello! Thanks for answer! My mistake ;-), Correct OPTIONS request in http://pastebin.com/MmRtTgiZ also with Ceph -v. static33 bucket was made on 0.67. best regards! On Mon, Sep 16, 2013 at 5:46 PM, Yehuda Sadeh wrote: > On Mon, Sep 16, 2013 at 3:46 AM, Pawel Stefanski > wrote: > > hello all

Re: [ceph-users] errors after kernel-upgrade -- Help needed

2013-09-16 Thread Gregory Farnum
Obviously your OSDs aren't getting all the PGs up and running. Have you followed the troubleshooting steps? (http://ceph.com/docs/master/rados/troubleshooting/troubleshooting-pg/) -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Mon, Sep 16, 2013 at 6:35 AM, Markus Goldberg

Re: [ceph-users] radosGW namespace

2013-09-16 Thread Yehuda Sadeh
Hi, currently different users share the same namespace. This follows the S3 semantics, and allows accessing buckets directly via a virtual host name. We do have multiple namespaces in mind though, and I also prototyped it not too long ago: http://wiki.ceph.com/01Planning/02Blueprints/Emperor/rg

[ceph-users] Pause i/o from time to time

2013-09-16 Thread Timofey
I use ceph for HA-cluster. Some time ceph rbd go to have pause in work (stop i/o operations). Sometime it can be when one of OSD slow response to requests. Sometime it can be my mistake (xfs_freeze -f for one of OSD-drive). I have 2 storage servers with one osd on each. This pauses can be few min

Re: [ceph-users] Rugged data distribution on OSDs

2013-09-16 Thread Gregory Farnum
What is your PG count and what's the output of "ceph osd tree"? It's possible that you've just got a slightly off distribution since there still isn't much data in the cluster (probabilistic placement and all that), but let's cover the basics first. -Greg Software Engineer #42 @ http://inktank.com

Re: [ceph-users] mds stuck in rejoin

2013-09-16 Thread Gregory Farnum
Awesome, glad a simple upgrade fixed it for you. :) -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Mon, Sep 16, 2013 at 6:18 AM, Serge Slipchenko wrote: > Hi, > > Digging the web I have found similar symptoms > http://tracker.ceph.com/issues/6087 > I have found that my cep

Re: [ceph-users] CORS not working

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 9:29 AM, Pawel Stefanski wrote: > hello! > > Thanks for answer! > > My mistake ;-), > Correct OPTIONS request in > http://pastebin.com/MmRtTgiZ That might have been fixed by the latest commit to dumpling. What version are you running? > also with Ceph -v. > static33 buck

Re: [ceph-users] problem with ceph-deploy hanging

2013-09-16 Thread Gruher, Joseph R
>But certainly, I am worried about why is it hanging for you here, this is a >problem and I really want to make sure this is either fixed or confirmed it was >some kind of misconfiguration. > >I believe that the problem is coming from using `sudo` + `root`. This is a >problem that is certainly fixe

[ceph-users] new puppet-cephdeploy module

2013-09-16 Thread Don Talton (dotalton)
As weird as it might seem, there is a puppet module now to automate ceph-deploy. It came about as Cisco has its own OpenStack installer platform which requires full orchestration. It might be of some use to others, so here is the link: https://github.com/dontalton/puppet-cephdeploy Donald Tal

Re: [ceph-users] problem with ceph-deploy hanging

2013-09-16 Thread Alfredo Deza
On Mon, Sep 16, 2013 at 1:58 PM, Gruher, Joseph R wrote: >>But certainly, I am worried about why is it hanging for you here, this is a >>problem and I really want to make sure this is either fixed or confirmed it >>was >>some kind of misconfiguration. >> >>I believe that the problem is coming fro

Re: [ceph-users] CORS not working

2013-09-16 Thread Pawel Stefanski
I've tried now with: http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/dumpling/pool/main/c/ceph/radosgw_0.67.3-10-g670db7e-1precise_amd64.deb And it works :-) Thanks!! On Mon, Sep 16, 2013 at 7:04 PM, Pawel Stefanski wrote: > I will try with dumpling master git build today. > 16 wr

Re: [ceph-users] getting started

2013-09-16 Thread Alfredo Deza
On Mon, Sep 16, 2013 at 12:58 PM, Justin Ryan wrote: > Hi, > > I'm brand new to Ceph, attempting to follow the Getting Started guide with 2 > VMs. I completed the Preflight without issue. I completed Storage Cluster > Quick Start, but have some questions: > > The Single Node Quick Start grey box

Re: [ceph-users] getting started

2013-09-16 Thread John Wilkins
We will have a new update to the quick start this week. On Mon, Sep 16, 2013 at 12:18 PM, Alfredo Deza wrote: > On Mon, Sep 16, 2013 at 12:58 PM, Justin Ryan wrote: >> Hi, >> >> I'm brand new to Ceph, attempting to follow the Getting Started guide with 2 >> VMs. I completed the Preflight without

[ceph-users] Stripping rados-classes libraries

2013-09-16 Thread Nick Bartos
Which symbols need to be kept when stripping the libraries in rados-classes? I found this e-mail from 2010: http://comments.gmane.org/gmane.comp.file-systems.ceph.devel/1543 Is it still just symbols that start with __cls_ that need to be kept? We compile ceph with debug symbols and strip them o

Re: [ceph-users] Stripping rados-classes libraries

2013-09-16 Thread Sage Weil
[added ceph-devel] On Mon, 16 Sep 2013, Nick Bartos wrote: > Which symbols need to be kept when stripping the libraries in rados-classes? > I found this e-mail from 2010: > > http://comments.gmane.org/gmane.comp.file-systems.ceph.devel/1543 > > Is it still just symbols that start with __cls_ tha

Re: [ceph-users] getting started

2013-09-16 Thread Justin Ryan
thanks, running as root does give me status, but not clean. r...@jr-ceph2.vm:~# ceph status cluster 9059dfad-924a-425c-a20b-17dc1d53111e health HEALTH_WARN 91 pgs degraded; 192 pgs stuck unclean; recovery 21/42 degraded (50.000%) monmap e1: 1 mons at {jr-ceph2=10.88.26.55:6789/0}, election

Re: [ceph-users] problem with ceph-deploy hanging

2013-09-16 Thread Gruher, Joseph R
>-Original Message- >From: Alfredo Deza [mailto:alfredo.d...@inktank.com] >Subject: Re: [ceph-users] problem with ceph-deploy hanging > >ceph-deploy will use the user as you are currently executing. That is why, if >you are calling ceph-deploy as root, it will log in remotely as root. > >So

[ceph-users] radosgw bucket question

2013-09-16 Thread
hi So what am I doing wrong? when i run commond: radosgw-admin bucket list --uid=johdone the return is [] and the commond radosgw-admin bucket list --uid=wkp4666 the return is [] and the commond radosgw-admin bucket listthe return is [mybucket1, mybucket2] mybucket1's owner is johdone

Re: [ceph-users] radosgw bucket question

2013-09-16 Thread Yehuda Sadeh
On Mon, Sep 16, 2013 at 7:21 PM, 鹏 wrote: > > > hi > So what am I doing wrong? when i run commond: > radosgw-admin bucket list --uid=johdone the return is [] > and the commond > radosgw-admin bucket list --uid=wkp4666 the return is [] > and the commond > radosgw-admin bucket listthe retu

Re: [ceph-users] radosgw bucket question

2013-09-16 Thread Gregory Farnum
[Removed ceph-devel] RGW, like Amazon S3, has a global bucket namespace. You already have a mybucket1, so the second user can't create another one. I believe Yehuda said recently that there's some work happening on multi tenancy that will give each user their own namespace? -Greg On Monday, Septe