[ceph-users] The woes of sequential reads

Hello, Nothing new, I know. But some numbers to mull and ultimately weep over. Ceph cluster based on Debian Jessie (thus ceph 0.72.x), 2 nodes, 2 OSDs each. Infiniband 4xQDR, IPoIB interconnects, 1 GByte/s bandwidth end to end. There was nothing going on aside from the tests. Just going to u

Re: [ceph-users] fuse or kernel to mount rbd?

Hi Sage et al, Thanks for the info! How stable are the cutting edge kernels like 3.13 ? Is 3.8 (e.g. from Ubuntu Raring) a better choice? Thanks again! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-use

Re: [ceph-users] fuse or kernel to mount rbd?

On Mon, 7 Apr 2014, Chad Seys wrote: > Hi Sage et al, > Thanks for the info! How stable are the cutting edge kernels like 3.13 ? > Is 3.8 (e.g. from Ubuntu Raring) a better choice? 3.8 will not support layering. >From RBD's perspective, the newest kernels are the most stable. If it were me

Re: [ceph-users] Recover cluster health after loosing 100% of OSDs.

On Sat, Apr 5, 2014 at 10:00 AM, Max Kutsevol wrote: > Hello! > > I am new to ceph, please take that into account. > > I'm experimenting with 3mons+2osds setup and got into situation when I > recreated both of osds. > > My pools: > ceph> osd lspools > 0 data,1 metadata, > > These are just the def

Re: [ceph-users] ceph-deploy fails to generate keys

[monitoprs do not start properly with ceph-deploy] Brian Chandler: > > thank you for your, response, however: > >> Including iptables? CentOS/RedHat default to iptables enabled and > >> closed. > >> > >> "iptables -Lvn" to be 100% sure. > > hvrrzceph1:~ # iptables -Lvn > > iptables: No chain/targe

Re: [ceph-users] osd map changed when upgrading from emperor to v0.78

Hi, I replace the code in the file /etc/init.d/ceph of v0.78 with the code of emperor and everything is ok for now. The replaced code: #Code of v0.78 if [ "$type" = "osd" ]; then get_conf update_crush "" "osd crush update on start" if [ "${update_crush:

[ceph-users] ceph yarn setup

Hi, As mentioned earlier, here is the link to how to guide to make yarn work with Ceph emperor. http://blog.uninettlabs.no/?p=54 Feel free to ask any questions. Gurvinder Singh Uninett AS ___ ceph-users mailing list ceph-users@lists.ceph.com http://li

[ceph-users] Error when building ceph. fatal error: civetweb/civetweb.h: No such file or directory

Hi, When i build ceph from source code that I downloaded from https://github.com/ceph/ceph/tree/v0.78, it has error as following: rgw/rgw_civetweb.cc:4:31: fatal error: civetweb/civetweb.h: No such file or directory compilation terminated. make[3]: *** [rgw/rgw_civetweb.o] Error 1 make[3]: Leavin

Re: [ceph-users] cannot remove rbd image, snapshot busy

Thanks. I managed to remove the images by unprotecting them first. On Fri, 2014-04-04 at 10:15 +0800, YIP Wai Peng wrote: > Yes. You can see whether the snapshots are protected by using snap rm > instead of snap purge. > > # rbd --pool mypool snap rm 5216ba99-1d8e-4155-9877-7d77d7b6caa0@snap > #

[ceph-users] ceph hbase issue

Hi, I am trying to make HBase 0.96 work on top of Ceph 0.72.2. When I start the Hbase-master I am getting this error. 2014-04-05 23:39:39,475 DEBUG [master:pltrd023:6] wal.FSHLog: Moved 1 WAL file(s) to /hbase/data/hbase/meta/1588230740/oldWALs 2014-04-05 23:39:39,538 FATAL [master:host:6

Re: [ceph-users] ceph-deploy fails to generate keys

On Mon, Apr 7, 2014 at 3:50 AM, Diedrich Ehlerding wrote: > [monitoprs do not start properly with ceph-deploy] > Brian Chandler: > >> > thank you for your, response, however: >> >> Including iptables? CentOS/RedHat default to iptables enabled and >> >> closed. >> >> >> >> "iptables -Lvn" to be 100

[ceph-users] osd map changed when upgrading from emperor to v0.78

Hi, First, i installed ceph with version emperor by mkcephfs, everything is ok. My cluster has 3 server. Please see http://pastebin.com/avTRfi5F for config information and additional information. Then, i upgraded to v0.78 and restart ceph, osd map changed (see "ceph osd tree" at http://pastebin.c

Re: [ceph-users] Error when building ceph. fatal error: civetweb/civetweb.h: No such file or directory

Hi Thanh, I think you miss the "$ git submodule update --init", which clones all the submodules required for compilation. Cheers, Kai At 2014-04-07 09:35:32,"Thanh Tran" wrote: Hi, When i build ceph from source code that I downloaded from https://github.com/ceph/ceph/tree/v0.78, it has err

[ceph-users] RadosGW: bad request

I'm getting these trying to upload any file: 2014-04-07 14:33:27.084369 7f5268f86700 5 Getting permissions id=testuser owner=testuser perm=2 2014-04-07 14:33:27.084372 7f5268f86700 10 uid=testuser requested perm (type)=2, policy perm=2, user_perm_mask=2, acl perm=2 2014-04-07 14:33:27.084377 7f5

[ceph-users] Active-Active iSCSI cluster

There's this articlethat says that you shouldn't ever do iSCSI multipath to multiple iSCSI targets on top of the same DRBD volume. Can someone tell me whether that is a limitation of DRBD, and that Ceph wou

Re: [ceph-users] RadosGW: bad request

On Mon, Apr 7, 2014 at 5:38 AM, Gandalf Corvotempesta wrote: > I'm getting these trying to upload any file: > > 2014-04-07 14:33:27.084369 7f5268f86700 5 Getting permissions > id=testuser owner=testuser perm=2 > 2014-04-07 14:33:27.084372 7f5268f86700 10 uid=testuser requested > perm (type)=2, p

Re: [ceph-users] ceph-deploy fails to generate keys

Is SELinux enabled? On Mon, Apr 7, 2014 at 12:50 AM, Diedrich Ehlerding wrote: > [monitoprs do not start properly with ceph-deploy] > Brian Chandler: > >> > thank you for your, response, however: >> >> Including iptables? CentOS/RedHat default to iptables enabled and >> >> closed. >> >> >> >> "ip

[ceph-users] Question about mark_unfound_lost on RGW metadata.

Ceph is telling me that it can't find some data: 2014-04-07 11:15:09.901992 mon.0 [INF] pgmap v5436846: 2592 pgs: 2164 active+clean, 142 active+remapped+wait_backfill, 150 active+degraded+wait_backfill, 1 active+recovering+degraded, 2 active+degraded+backfilling, 133 active+degraded+remapped+wa

[ceph-users] v0.79 released (firefly release candicate)

This release is intended to serve as a release candidate for firefly, which will hopefully be v0.80. No changes are being made to the code base at this point except those that fix bugs. Please test this release if you intend to make use of the new erasure-coded pools or cache tiers in firefly

[ceph-users] atomic + asynchr

I am using the Ceph C api to create and update Ceph objects and their respective omaps and xattributes. I have two requirements: 1. Write operations must be written atomically such that either all updates to an object complete, or, all updates to the object fail. If even one update fails th

[ceph-users] RadosGW Quotas

Hi, Most likely Yehuda can speak to this. So there is some documentation on the way to set quotas for a user in master (src/rgw/rgw_rest_user.cc line 712) but these are not in the docs it seems yet. I have started to incorporate them but I don't see anything as an example for how to document the

Re: [ceph-users] RadosGW Quotas

On Mon, Apr 7, 2014 at 4:34 PM, Derek Yarnell wrote: > Hi, > > Most likely Yehuda can speak to this. So there is some documentation on > the way to set quotas for a user in master (src/rgw/rgw_rest_user.cc > line 712) but these are not in the docs it seems yet. I have started to > incorporate the

Re: [ceph-users] RadosGW Quotas

Derek, I have some. I'll get them by the end of the week at the latest. On Mon, Apr 7, 2014 at 4:52 PM, Yehuda Sadeh wrote: > On Mon, Apr 7, 2014 at 4:34 PM, Derek Yarnell > wrote: > > Hi, > > > > Most likely Yehuda can speak to this. So there is some documentation on > > the way to set quot

[ceph-users] OpenStack Survey

Greetings Cephers! If you haven't been following news in the OpenStack world it might be easy to miss that another user survey is being collected to assess what the OpenStack landscape looks like. We'd really love it if you could go tell your OpenStack story, especially since we love to make sure

[ceph-users] RGW and Object Lifecycle Managment

Does RGW support the S3 Object Lifecycle Management? http://docs.aws.amazon.com/AmazonS3/latest/dev/object-lifecycle-mgmt.html I'm not finding much using Google, or the Ceph wiki search. The best I found was https://ceph.com/docs/master/radosgw/swift/tutorial/, which explains how manually cre

Re: [ceph-users] Question about mark_unfound_lost on RGW metadata.

The PG with the unfound object has been in active+recovering+degraded state for much longer than usual. Most PGs spend about 20 minutes in that state, then complete. This one has been in this in active+recovering+degraded for about 4 hours now. 11.483885118852179742559063

Re: [ceph-users] Question about mark_unfound_lost on RGW metadata.

Is this because it can't find the unfound object? Or is this because I set osd flag noout and nodown? Sorry, I meant to say, is it because I set: root@ceph0c:~# ceph osd dump | grep 'flags' flags nodown,noout,noscrub,nodeep-scrub ___ ceph-users ma

Re: [ceph-users] RGW and Object Lifecycle Managment

Nope, that's not supported. See http://ceph.com/docs/master/radosgw/s3/#features-support -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Mon, Apr 7, 2014 at 6:41 PM, Craig Lewis wrote: > Does RGW support the S3 Object Lifecycle Management? > http://docs.aws.amazon.com/Amazo