Re: [ceph-users] Unable top start instance in openstack

2014-02-20 Thread Sebastien Han
Which distro and packages? libvirt_image_type is broken on cloud archive, please patch with https://github.com/jdurgin/nova/commits/havana-ephemeral-rbd Cheers. Sébastien Han Cloud Engineer "Always give 100%. Unless you're giving blood.” Phone: +33 (0)1 49 70 99 72 Mail: sebastien...

Re: [ceph-users] Disk failed - simulation - but still healthy

2014-02-20 Thread Thorvald Hallvardsson
We did another simulation yesterday with the benchmark running. When we detached the drive when the benchmark was running ceph noticed that straight away and marked osd.6 as down. So in the first test when we had no IO something must have hit it after 1 hour what spotted osd.6 doesn't exist anymo

Re: [ceph-users] smart replication

2014-02-20 Thread Christian Kauhaus
Am 19.02.2014 12:01, schrieb Pavel V. Kaygorodov: > Is it possible to do this with ceph? > If yes, how to configure this? I think this can be achieved through multiple CRUSH rulesets. There is an example in the docs which explains how to differentiate between SSD and non-SSD storage: http://ceph.

[ceph-users] Flapping/Crashing OSD

2014-02-20 Thread Michael
Hi All, Have a log full of - "log [ERR] : 1.9 log bound mismatch, info (46784'1236417,46797'1239418] actual [46784'1235968,46797'1239418]" "192.168.7.177:6800/15655 >> 192.168.7.183:6802/3348 pipe(0x20e4f00 sd=65 :56394 s=2 pgs=24194 cs=1 l=0 c=0x19668f20).fault, initiating reconnect" and

[ceph-users] [rgw] increase the first chunk size

2014-02-20 Thread Ray Lv
Hi, Currently, the first chunk size of a radosgw object is 512KB. Here is a case that most of data workload gets to radosgw is ~ 4MB. With the current first chunk size, each radosgw object is stripped to two chunks (512K + 3.5M). And we’re using several large disks on each host with 40TB capaci

Re: [ceph-users] CephFS to provide distributed access read/write

2014-02-20 Thread Listas@Adminlinux
Thanks Robert! I would not want a specific solution Dovecot. Why in the future I plan to use the model to improve clustered webservers and other services. Regards -- Thiago Henrique www.adminlinux.com.br Em 19-02-2014 12:46, Robert Sander escreveu: On 19.02.2014 14:55, Listas@Adminlinux wrot

Re: [ceph-users] CephFS and slow requests

2014-02-20 Thread Gregory Farnum
Arne, Sorry this got dropped -- I had it marked in my mail but didn't have the chance to think about it seriously when you sent it. Does this still happen after the updatedb config change you guys made recently? -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Fri, Jan 31, 20

Re: [ceph-users] Ceph GET latency

2014-02-20 Thread Gregory Farnum
On Tue, Feb 18, 2014 at 7:24 AM, Guang Yang wrote: > Hi ceph-users, > We are using Ceph (radosgw) to store user generated images, as GET latency > is critical for us, most recently I did some investigation over the GET path > to understand where time spend. > > I first confirmed that the latency c

Re: [ceph-users] ceph-mon segmentation fault

2014-02-20 Thread Gregory Farnum
I created a ticket: http://tracker.ceph.com/issues/7487 But my guess is that this is a result of having 0 CRUSH weight for the entire tree while linking them up. Can you give the OSD a weight and see if it works after that? -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Tu

Re: [ceph-users] Journal thoughts

2014-02-20 Thread Gregory Farnum
On Mon, Feb 17, 2014 at 12:29 AM, Alex Pearson wrote: > Hi All, > I've been looking, but haven't been able to find any detailed documentation > about the journal usage on OSDs. Does anyone have any detailed docs they > could share? My initial questions are: Hmm, I'm not sure if we have any se

Re: [ceph-users] stuck unclean/stuck inactive

2014-02-20 Thread Gregory Farnum
On Thu, Jan 30, 2014 at 1:17 PM, Derek Yarnell wrote: > Hi, > > So I am trying to remove OSDs from one of our 6 ceph OSDs, this is a > brand new cluster and no data is yet on it. I was following the manual > procedure[1] with the following script. I removed OSDs 0-3 but I am > seeing ceph not fu

[ceph-users] monitor data

2014-02-20 Thread Pavel V. Kaygorodov
Hi! May be it is a dumb question, but anyway: If I lose all monitors (mon data dirs), does it possible to recover cluster with data from OSDs only? Pavel. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-

Re: [ceph-users] monitor data

2014-02-20 Thread Wido den Hollander
> Op 20 feb. 2014 om 16:52 heeft "Pavel V. Kaygorodov" het > volgende geschreven: > > Hi! > > May be it is a dumb question, but anyway: > > If I lose all monitors (mon data dirs), does it possible to recover cluster > with data from OSDs only? > Very unlikely and if so, very hard to do

Re: [ceph-users] Journal thoughts

2014-02-20 Thread Mark Nelson
On 02/20/2014 09:25 AM, Gregory Farnum wrote: On Mon, Feb 17, 2014 at 12:29 AM, Alex Pearson wrote: Hi All, I've been looking, but haven't been able to find any detailed documentation about the journal usage on OSDs. Does anyone have any detailed docs they could share? My initial questions

Re: [ceph-users] monitor data

2014-02-20 Thread Gregory Farnum
On Thu, Feb 20, 2014 at 7:52 AM, Pavel V. Kaygorodov wrote: > Hi! > > May be it is a dumb question, but anyway: > > If I lose all monitors (mon data dirs), does it possible to recover cluster > with data from OSDs only? Short version: no. Long version: probably, if you're willing to spend lots o

[ceph-users] swift & s3 on radosgw

2014-02-20 Thread Liu, Larry
Hi, Swift -A command works perfectly fine on my setup. I wonder anyone has good docs how to run curl to retrieve x-token, and how to make a simple .s3cfg file. The docs on ceph.com don't really cover this area very well. Thanks. ___ ceph-users mailing

Re: [ceph-users] unable to start OSD

2014-02-20 Thread Samuel Just
What has happened in the last few weeks to this cluster? Was there an upgrade? -Sam On Wed, Feb 12, 2014 at 10:07 AM, Dietmar Maurer wrote: >> > It would be great to get two logs from two different crashing OSDs for >> > comparison purposes. >> >> ftp://download.proxmox.com/tmp/ceph-osd.4.log >>

[ceph-users] questions about ceph cluster in multi-dacenter

2014-02-20 Thread Alexandre DERUMIER
Hi, I'm looking to build a ceph cluster in a multi datacenter architecture. Datas will be stored on DC1 and DC2 (mon + osds), and we'll have a third datacenter DC3, with a monitor only for quorum 2x dark fiber DC1<->DC2 |<> | |

[ceph-users] v0.77 released

2014-02-20 Thread Sage Weil
This is the final development release before the Firefly feature freeze. The main items in this release include some additional refactoring work in the OSD IO path (include some locking improvements), per-user quotas for the radosgw, a switch to civetweb from mongoose for the prototype radosgw sta

Re: [ceph-users] questions about ceph cluster in multi-dacenter

2014-02-20 Thread Kyle Bader
> What could be the best replication ? Are you using two sites to increase availability, durability, or both? For availability your really better off using three sites and use CRUSH to place each of three replicas in a different datacenter. In this setup you can survive losing 1 of 3 datacenters.

Re: [ceph-users] ceph-mon segmentation fault

2014-02-20 Thread Gregory Farnum
[Re-added the list] On Thu, Feb 20, 2014 at 8:09 AM, Pavel V. Kaygorodov wrote: > Hi! > >> I created a ticket: http://tracker.ceph.com/issues/7487 >> >> But my guess is that this is a result of having 0 CRUSH weight for the >> entire tree while linking them up. Can you give the OSD a weight and >

Re: [ceph-users] Flapping/Crashing OSD

2014-02-20 Thread Gregory Farnum
On Thu, Feb 20, 2014 at 4:26 AM, Michael wrote: > Hi All, > > Have a log full of - > > "log [ERR] : 1.9 log bound mismatch, info (46784'1236417,46797'1239418] > actual [46784'1235968,46797'1239418]" Do you mean that error message is showing up for a lot of different PGs? The specific error indica

Re: [ceph-users] ceph-mon segmentation fault

2014-02-20 Thread Pavel V. Kaygorodov
Hi! >>> I created a ticket: http://tracker.ceph.com/issues/7487 >>> >>> But my guess is that this is a result of having 0 CRUSH weight for the >>> entire tree while linking them up. Can you give the OSD a weight and >>> see if it works after that? >> >> How to do this? >> I still not very famili

Re: [ceph-users] hashpspool and backfilling

2014-02-20 Thread Gregory Farnum
On Tue, Feb 18, 2014 at 8:21 AM, Dan van der Ster wrote: > Hi, > Today I've noticed an interesting result of not have hashpspool > enabled on a number of pools -- backfilling is delayed. > > Take for example the following case: a PG from each of 5 different > pools (details below) are all mapped t

Re: [ceph-users] Flapping/Crashing OSD

2014-02-20 Thread Michael
Thanks Gregory. Currently it's just the one OSD with the issue. If it's more of a general failing of an OSD I'll rip it out and replace the drive. -Michael On 20/02/2014 17:55, Gregory Farnum wrote: On Thu, Feb 20, 2014 at 4:26 AM, Michael wrote: Hi All, Have a log full of - "log [ERR] :

Re: [ceph-users] Swift APIs not authenticating Rados gateway !!!

2014-02-20 Thread Liu, Larry
Hi Yehuda, Is there any doc on how to set the swift url (rgw swift url) configurable? On 2/19/14 7:42 AM, "Yehuda Sadeh" wrote: >On Wed, Feb 19, 2014 at 2:37 AM, Srinivasa Rao Ragolu > wrote: >> Hi all, >> >> I have setup cluster successfully and one node using to setup rados >>gateway. >> Mach

[ceph-users] Ceph talks at OpenStack: Atlanta

2014-02-20 Thread Patrick McGarry
Hey all, I'm sure many of you are planning on attending the OpenStack Summit in Atlanta this May so I wanted to make it easy to vote up Ceph-related content. If you haven't voted for your favorite proposed OpenStack talks just remember, there is only a little over 1 week remaining! Here is a lis

[ceph-users] Fwd: [rgw] increase the first chunk size

2014-02-20 Thread Yehuda Sadeh
Apparently I missed including the mailing list in the response. -- Forwarded message -- From: Yehuda Sadeh Date: Thu, Feb 20, 2014 at 9:04 AM Subject: Re: [ceph-users] [rgw] increase the first chunk size To: Ray Lv On Thu, Feb 20, 2014 at 5:08 AM, Ray Lv wrote: > Hi, > > Curre

Re: [ceph-users] hashpspool and backfilling

2014-02-20 Thread Dan van der Ster
Hi, On Thu, Feb 20, 2014 at 7:47 PM, Gregory Farnum wrote: > On Tue, Feb 18, 2014 at 8:21 AM, Dan van der Ster > wrote: > > Hi, > > Today I've noticed an interesting result of not have hashpspool > > enabled on a number of pools -- backfilling is delayed. > > > > Take for example the following

Re: [ceph-users] hashpspool and backfilling

2014-02-20 Thread Gregory Farnum
On Thu, Feb 20, 2014 at 12:48 PM, Dan van der Ster wrote: > Hi, > > On Thu, Feb 20, 2014 at 7:47 PM, Gregory Farnum wrote: >> >> On Tue, Feb 18, 2014 at 8:21 AM, Dan van der Ster >> wrote: >> > Hi, >> > Today I've noticed an interesting result of not have hashpspool >> > enabled on a number of p

Re: [ceph-users] v0.77 released

2014-02-20 Thread Derek Yarnell
> * rgw: user quotas (Yehuda Sadeh) Hi, Now that there will be both bucket and user level quotas (which thank you yehuda this is critical to what we want to do with ceph in our organization) can you elaborate on the behavior in some scenarios? If a user is at their user quota but is trying to w

Re: [ceph-users] v0.77 released

2014-02-20 Thread Yehuda Sadeh
On Thu, Feb 20, 2014 at 1:40 PM, Derek Yarnell wrote: > >> * rgw: user quotas (Yehuda Sadeh) > > Hi, > > Now that there will be both bucket and user level quotas (which thank > you yehuda this is critical to what we want to do with ceph in our > organization) can you elaborate on the behavior in s

[ceph-users] adding placement pool to radosgw

2014-02-20 Thread Michael Nelson
I am trying to add a placement pool to radosgw (based on http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4992), but radosgw keeps complaining in the log that it can't find the placement rule when I create a bucket using s3cmd: s3cmd --bucket-location=:two-placement mb s3://foo Is

Re: [ceph-users] adding placement pool to radosgw

2014-02-20 Thread Yehuda Sadeh
On Thu, Feb 20, 2014 at 2:18 PM, Michael Nelson wrote: > I am trying to add a placement pool to radosgw (based on > http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4992), but > radosgw keeps complaining in the log that it can't find the placement rule > when I create a bucket using s3c

Re: [ceph-users] adding placement pool to radosgw

2014-02-20 Thread Michael Nelson
On Thu, 20 Feb 2014, Yehuda Sadeh wrote: On Thu, Feb 20, 2014 at 2:18 PM, Michael Nelson wrote: I am trying to add a placement pool to radosgw (based on http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4992), but radosgw keeps complaining in the log that it can't find the placement

Re: [ceph-users] Swift APIs not authenticating Rados gateway !!!

2014-02-20 Thread Srinivasa Rao Ragolu
Please help in making it easy Rados gateway configurable with Swift. It would be great support from you. I have skipped only two sections in http://ceph.com/docs/master/install/install-ceph-gateway/ a) Enable SSL and b) Add wildcard to DNS Apart from these steps I have followed all other instruc