Re: [ceph-users] xfsprogs not found in RHEL

Check this issue: http://tracker.ceph.com/issues/5193 You might need the RHEL Scalable File System add-on. Cheers, -- Daniele Stroppa Researcher Institute of Information Technology Zürich University of Applied Sciences http://www.cloudcomp.ch From: sriram mailto:sriram

Re: [ceph-users] xfsprogs not found in RHEL

Tried "yum clean all" followed by "yum install ceph" and the same result. On Tue, Aug 27, 2013 at 7:44 PM, Lincoln Bryant wrote: > Hi, > > xfsprogs should be included in the EL6 base. > > Perhaps run "yum clean all" and try again? > > Cheers, > Lincoln > > On Aug 27, 2013, at 9:16 PM, sriram w

Re: [ceph-users] xfsprogs not found in RHEL

Hi, xfsprogs should be included in the EL6 base. Perhaps run "yum clean all" and try again? Cheers, Lincoln On Aug 27, 2013, at 9:16 PM, sriram wrote: > I am trying to install CEPH and I get the following error - > > ---> Package ceph.x86_64 0:0.67.2-0.el6 will be installed > --> Processing

[ceph-users] xfsprogs not found in RHEL

I am trying to install CEPH and I get the following error - ---> Package ceph.x86_64 0:0.67.2-0.el6 will be installed --> Processing Dependency: xfsprogs for package: ceph-0.67.2-0.el6.x86_64 ---> Package python-babel.noarch 0:0.9.4-5.1.el6 will be installed ---> Package python-backports-ssl_match

[ceph-users] xfsprogs not found in RHEL

I am trying to install CEPH and I get the following error - ---> Package ceph.x86_64 0:0.67.2-0.el6 will be installed --> Processing Dependency: xfsprogs for package: ceph-0.67.2-0.el6.x86_64 ---> Package python-babel.noarch 0:0.9.4-5.1.el6 will be installed ---> Package python-backports-ssl_match

Re: [ceph-users] Some help needed with ceph deployment

ot;: "1.1e", > >   "osds": [ > >     2, > >     0]}, > >     { "pgid": "1.1f", > >   "osds": [ > >     2, > >     1]}, > >     { &quo

[ceph-users] Could you add me to the subscribe list?

___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Real size of rbd image

Le mardi 27 août 2013 à 13:44 -0700, Josh Durgin a écrit : > On 08/27/2013 01:39 PM, Timofey Koolin wrote: > > Is way to know real size of rbd image and rbd snapshots? > > rbd ls -l write declared size of image, but I want to know real size. > > You can sum the sizes of the extents reported by: >

[ceph-users] Geek On Duty: Hours Update

Hey all! We’ve moved our Friday “Geek on Duty” shift from 1pm PT to 8am PT. You can see the new calendar here: http://ceph.com/help/community/ We’re a bit light on US-friendly shifts at the moment. If anyone wants to volunteer to be a Geek on Duty, tell commun...@ceph.com and we’ll set you up

Re: [ceph-users] Limitations of Ceph

On Tue, Aug 27, 2013 at 10:19 AM, Sage Weil wrote: > > Hi Guido! > > On Tue, 27 Aug 2013, Guido Winkelmann wrote: > > Hi, > > > > I have been running a small Ceph cluster for experimentation for a while, and > > now my employer has asked me to do little talk about my findings, and one > > importan

Re: [ceph-users] Real size of rbd image

On 08/27/2013 01:39 PM, Timofey Koolin wrote: Is way to know real size of rbd image and rbd snapshots? rbd ls -l write declared size of image, but I want to know real size. You can sum the sizes of the extents reported by: rbd diff pool/image[@snap] [--format json] That's the difference s

[ceph-users] Real size of rbd image

Is way to know real size of rbd image and rbd snapshots? rbd ls -l write declared size of image, but I want to know real size. -- Blog: www.rekby.ru ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph

Re: [ceph-users] problem uploading 1GB and up file

Since you mention a problem starting at 1GB, check to see if you have a LimitRequestBody directive (http://httpd.apache.org/docs/2.2/mod/core.html#limitrequestbody) The|LimitRequestBody|directive allows the user to set a limit on the allowed size of an HTTP request message body within the

Re: [ceph-users] Limitations of Ceph

On Tue, 27 Aug 2013, Guido Winkelmann wrote: > Hi Sage, > > Thanks for your comments, much appreciated. > > Am Dienstag, 27. August 2013, 10:19:46 schrieb Sage Weil: > > Hi Guido! > > > > On Tue, 27 Aug 2013, Guido Winkelmann wrote: > [...] > > > - There is no dynamic tiered storage, and there p

[ceph-users] Fedora 18 Qemu

Does anyone have the best patches for Fedora 18 qemu that fixes aio issues? I have built my own but am having mixed results? Its qemu 1.2.2 Or would it be better to jump to Fedora 19. I am running Fedora 18 in hopes that RHEL 7 will be based on it. Thanks, Joe -- Joe Ryner Center for the A

Re: [ceph-users] Limitations of Ceph

Hi Sage, Thanks for your comments, much appreciated. Am Dienstag, 27. August 2013, 10:19:46 schrieb Sage Weil: > Hi Guido! > > On Tue, 27 Aug 2013, Guido Winkelmann wrote: [...] > > - There is no dynamic tiered storage, and there probably never will be, if > > I understand the architecture corre

Re: [ceph-users] Administering a ceph cluster

This is an error in the docs. Upstart jobs apply to each node. I've updated the docs to reflect this understanding. When deployed as a service with the -a option, ceph would start daemons across nodes. With upstart, you need to start and stop by invoking upstart on each node. On Tue, Aug 27, 2013

Re: [ceph-users] Limitations of Ceph

Hi Guido! On Tue, 27 Aug 2013, Guido Winkelmann wrote: > Hi, > > I have been running a small Ceph cluster for experimentation for a while, and > now my employer has asked me to do little talk about my findings, and one > important part is, of course, going to be practical limitations of Ceph. >

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Something ala: https://lwn.net/Articles/340010/ On 08/27/2013 12:06 PM, Ian Colle wrote: Oliver, Could you please have perf generate a call graph? That would be very interesting as we look deeper into this. Thanks! Ian On 8/27/13 8:55 AM, "Oliver Daudey" wrote: Hey Samuel, These:

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Oliver, Could you please have perf generate a call graph? That would be very interesting as we look deeper into this. Thanks! Ian On 8/27/13 8:55 AM, "Oliver Daudey" wrote: >Hey Samuel, > >These: >osd op threads = 8 >osd disk threads = 2 >filestore op threads = 8 > >T

[ceph-users] Administering a ceph cluster

Hi, So I have already setup a shiny new Ceph cluster (in one single machine, quantal64, adminstered from another machine, precise64). Now, for operating the cluster, I am a bit unsure on how to interpret the docs in http://ceph.com/docs/next/rados/operations/operating/. My interpretation is that

Re: [ceph-users] Problems with keyrings during deployment

On Tue, Aug 27, 2013 at 12:30 PM, Francesc Alted wrote: > On Tue, Aug 27, 2013 at 6:25 PM, Alfredo Deza wrote: > >> >> >> >> On Tue, Aug 27, 2013 at 12:04 PM, Francesc Alted >> wrote: >> >>> On Tue, Aug 27, 2013 at 5:29 PM, Sage Weil wrote: >>> On Tue, 27 Aug 2013, Francesc Alted wrote: >>>

[ceph-users] Limitations of Ceph

Hi, I have been running a small Ceph cluster for experimentation for a while, and now my employer has asked me to do little talk about my findings, and one important part is, of course, going to be practical limitations of Ceph. Here is my list so far: - Ceph is not supported by VMWare ESX. Th

Re: [ceph-users] Problems with keyrings during deployment

On Tue, Aug 27, 2013 at 6:25 PM, Alfredo Deza wrote: > > > > On Tue, Aug 27, 2013 at 12:04 PM, Francesc Alted wrote: > >> On Tue, Aug 27, 2013 at 5:29 PM, Sage Weil wrote: >> >>> On Tue, 27 Aug 2013, Francesc Alted wrote: >>> > Hi again, >>> > >>> > I continue to try debugging the problem reporte

Re: [ceph-users] Problems with keyrings during deployment

On Tue, Aug 27, 2013 at 12:04 PM, Francesc Alted wrote: > On Tue, Aug 27, 2013 at 5:29 PM, Sage Weil wrote: > >> On Tue, 27 Aug 2013, Francesc Alted wrote: >> > Hi again, >> > >> > I continue to try debugging the problem reported before. Now, I have >> been >> > trying to use a couple of VM for

Re: [ceph-users] Storage, File Systems and Data Scrubbing

On Tue, 27 Aug 2013, ker can wrote: > This was very helpful -thanks.  However I'm still trying to reconcile this > with something that Sage mentioned a while back on a similar topic. > Apparently you can disable the journal if you're using  btrfs.  Is that > possible because btrfs takes care of thi

Re: [ceph-users] Problems with keyrings during deployment

On Tue, Aug 27, 2013 at 5:29 PM, Sage Weil wrote: > On Tue, 27 Aug 2013, Francesc Alted wrote: > > Hi again, > > > > I continue to try debugging the problem reported before. Now, I have > been > > trying to use a couple of VM for doing this (one with Ubuntu 12.04 > 64-bit, > > and the other with

[ceph-users] problem uploading 1GB and up file

Hello, I got a weird upload issue with Ceph - dumpling (0.67.2) and I don't know if someone can help me out to pin point my problem... Basically, If I'm trying to upload a 1Gb file, as soon as my upload is completed, apache return a 500 error... no problem if I upload a 900Mb file or less, j

Re: [ceph-users] Some help needed with ceph deployment

al-tries 50 -o /tmp/crush.new > > root@ceph-admin:/etc/ceph# ceph osd setcrushmap -i /tmp/crush.new > >   > > but I?m not sure what he is trying to do here. Especially > ?enable-unsafe-tunables seems a little ? unsafe. > >   > > I also read > thishttp://eu.ceph.c

Re: [ceph-users] Problems with keyrings during deployment

On Tue, 27 Aug 2013, Francesc Alted wrote: > Hi again, > > I continue to try debugging the problem reported before.  Now, I have been > trying to use a couple of VM for doing this (one with Ubuntu 12.04 64-bit, > and the other with Ubuntu 12.10 64-bit, and I use the ceph.com repos for > installing

Re: [ceph-users] Ceph + Xen - RBD io hang

Hi James, Can you post the contents of the hung task warning so we can see where it is stuck? Thanks! sage On Tue, 27 Aug 2013, James Dingwall wrote: > Hi, > > I am doing some experimentation with Ceph and Xen (on the same host) and I'm > experiencing some problems with the rbd device that I

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Oliver, This patch isn't in dumpling head yet, you may want to wait on a dumpling point release. -Sam On Tue, Aug 27, 2013 at 8:13 AM, Mark Nelson wrote: > Ok, definitely let us know how it goes! For what it's worth, I'm testing > Sam's wip-dumpling-perf branch with the wbthrottle code disabled

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Ok, definitely let us know how it goes! For what it's worth, I'm testing Sam's wip-dumpling-perf branch with the wbthrottle code disabled now and comparing it both to that same branch with it enabled along with 0.67.1. Don't have any perf data, but quite a bit of other data to look through, b

Re: [ceph-users] ceph-deploy pushy dependency problem

Hi Mike - We released a 1.2.2 version recently that should have the correct dependency. You may have to do an "aptitude update" to refresh the cache. I did a test install on our debian wheezy system and that correctly updated the python pushy package. let me know if you continue to have p

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Mark, That will take a day or so for me to know with enough certainty. With the low CPU-usage and preliminary results today, I'm confident enough to upgrade all OSDs in production and test the cluster all-Dumpling tomorrow. For now, I only upgraded a single OSD and measured CPU-usage and wha

Re: [ceph-users] Storage, File Systems and Data Scrubbing

This was very helpful -thanks. However I'm still trying to reconcile this with something that Sage mentioned a while back on a similar topic. Apparently you can disable the journal if you're using btrfs. Is that possible because btrfs takes care of things like atomic object writes and updates to

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

On 08/27/2013 09:55 AM, Oliver Daudey wrote: Hey Samuel, These: osd op threads = 8 osd disk threads = 2 filestore op threads = 8 They increased performance on my test-cluster, but seemed to have the opposite effect on the much heavier loaded production-environment.

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Samuel, These: osd op threads = 8 osd disk threads = 2 filestore op threads = 8 They increased performance on my test-cluster, but seemed to have the opposite effect on the much heavier loaded production-environment. Regards, Oliver On 27-08-13 16:37, Samu

Re: [ceph-users] ceph-deploy pushy dependency problem

Hi Kevin - The latest version, ceph-deploy 1.2.2 in the ceph rpm-dumpling repo should have the correct dependency (see below).If doesn't work for you, or if you are using a different repo please let me know. Thanks, Gary ubuntu@jenkins:~/repos/rpm-dumpling/fc19/noarch$ rpm -q --requires

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

What options were you using? -Sam On Tue, Aug 27, 2013 at 7:35 AM, Oliver Daudey wrote: > Hey Ian, Samuel, > > FYI: I still had some attempted optimization-options in place on the > production-cluster, which might have skewed my results a bit. OSD > version 0.67.2-16-geeb1f86 seems to be a lot l

Re: [ceph-users] 1 particular ceph-mon never jobs on 0.67.2

Hi James, Yes, all configured using the interfaces file. Only two interfaces, eth0 and eth1: auto eth0 iface eth0 inet dhcp auto eth1 iface eth1 inet dhcp I took a single node and rebooted it several times, and it really was about 50/50 whether or not the OSDs showed up under 'localhost' or "n

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Ian, Samuel, FYI: I still had some attempted optimization-options in place on the production-cluster, which might have skewed my results a bit. OSD version 0.67.2-16-geeb1f86 seems to be a lot less hard on the CPU in the configuration that I did all other tests in. I haven't yet verified suf

Re: [ceph-users] Problems with keyrings during deployment

On Tue, Aug 27, 2013 at 7:15 AM, Francesc Alted wrote: > Hi again, > > I continue to try debugging the problem reported before. Now, I have been > trying to use a couple of VM for doing this (one with Ubuntu 12.04 64-bit, > and the other with Ubuntu 12.10 64-bit, and I use the ceph.com repos for

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

On Aug 27, 2013, at 2:08, Oliver Daudey wrote: > Hey Samuel, > > The "PGLog::check()" is now no longer visible in profiling, so it helped > for that. Unfortunately, it doesn't seem to have helped to bring down > the OSD's CPU-loading much. Leveldb still uses much more than in > Cuttlefish. O

Re: [ceph-users] Some help needed with ceph deployment

OK status. Regards, Johannes __ Informatie van ESET Endpoint Antivirus, versie van database viruskenmerken 8733 (20130827) __ Het bericht is gecontroleerd door ESET Endpoint Antivirus. http://www.eset.com ___ ceph-users mai

Re: [ceph-users] Storage, File Systems and Data Scrubbing

ormatie van ESET Endpoint Antivirus, versie van database > viruskenmerken 8713 (20130821) ______ > > Het bericht is gecontroleerd door ESET Endpoint Antivirus. > > http://www.eset.com > > > > ___ > ceph-users mailing list &

Re: [ceph-users] ceph-deploy pushy dependency problem

I'm having the same issue on debian 7.1. When reinstalling ceph-deploy after purge I get the following: root@vl0181:~# aptitude install ceph-deploy The following NEW packages will be installed: ceph-deploy{b} 0 packages upgraded, 1 newly installed, 0 to remove and 0 not upgraded. Need to get 3

Re: [ceph-users] Problems with keyrings during deployment

Hi again, I continue to try debugging the problem reported before. Now, I have been trying to use a couple of VM for doing this (one with Ubuntu 12.04 64-bit, and the other with Ubuntu 12.10 64-bit, and I use the ceph.com repos for installing the Ceph libraries). And, unfortunately, I am getting

Re: [ceph-users] 1 particular ceph-mon never jobs on 0.67.2

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 26/08/13 19:31, Sage Weil wrote: >>> I'm wondering what kind of delay, or additional "start-on" >>> logic I can add to the upstart script to work around this. > Hmm, this is beyond my upstart-fu, unfortunately. This has come up > before, actuall

[ceph-users] ceph-deploy pushy dependency problem

Hey ceph devs, I think there is a problem with your dependencies in the current version of ceph-deploy for FC19 (and probably other redhat variants). The package ceph-deploy explictly requires python-pushy >= 0.5.3, but the pushy package is simply named "pushy" (and is the correct version). The

[ceph-users] Ceph-OSD on compute nodes?

How does the community feel about running OSDs on the same node as openstack compute? What if its only 3 sata disks? Isnt ceph-OSD a bit to CPU and ram hungry for doing such a thing and would lead little left over for vm instances? Just curious as I just saw someone in a forum that said they wer

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hi Olver/Matthew, Ignoring CPU usage, has speed remained slower as well? Mark On 08/27/2013 03:08 AM, Oliver Daudey wrote: Hey Samuel, The "PGLog::check()" is now no longer visible in profiling, so it helped for that. Unfortunately, it doesn't seem to have helped to bring down the OSD's CPU-

Re: [ceph-users] Problems with keyrings during deployment

Hey Francesc, I encountered these while playing with ceph-deploy a couple of days earlier. Haven't done any troubleshooting on it yet. I encountered the error with the "gatherkeys"-option, just like you did. Regards, Oliver On di, 2013-08-27 at 13:18 +0200, Francesc Alted wrote: > H

Re: [ceph-users] Problems with keyrings during deployment

Hi again, I continue to try debugging the problem reported before. Now, I have been trying to use a couple of VM for doing this (one with Ubuntu 12.04 64-bit, and the other with Ubuntu 12.10 64-bit, and I use the ceph.com repos for installing the Ceph libraries). And, unfortunately, I am getting

Re: [ceph-users] Ceph + Xen - RBD io hang

Hi, I use Ceph 0.61.8 and Xen 4.2.2 (Debian) in production, and can't use kernel 3.10.* on dom0, which hang very soon. But it's visible in kernel logs of the dom0, not the domU. Anyway, you should probably re-try with kernel 3.9.11 for the dom0 (I also use 3.10.9 in domU). Olivier Le mardi 27 a

[ceph-users] Ceph + Xen - RBD io hang

Hi, I am doing some experimentation with Ceph and Xen (on the same host) and I'm experiencing some problems with the rbd device that I'm using as the block device. My environment is: 2 node Ceph 0.67.2 cluster, 4x OSD (btrfs) and 1x mon Xen 4.3.0 Kernel 3.10.9 The domU I'm trying to build i

Re: [ceph-users] lvm for a quick ceph lab cluster test

On 26.08.2013 23:07, Samuel Just wrote: > Seems reasonable to me. I'm not sure I've heard anything about using > LVM under ceph. Let us know how it goes! We are currently using it on a test cluster distributed on our desktops. Loïc Dachary visited us and wrote a small article: http://dachary.org

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Samuel, The "PGLog::check()" is now no longer visible in profiling, so it helped for that. Unfortunately, it doesn't seem to have helped to bring down the OSD's CPU-loading much. Leveldb still uses much more than in Cuttlefish. On my test-cluster, I didn't notice any difference in the RBD b

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hi Sam, It looks like that has dropped the CPU usage a fair bit. CPU usage still seems a bit higher than Cuttlefish but that might just be due to the levelDB changes. Here's the updated perf report - Events: 80K cycles 17.25% ceph-osd libc-2.15.so [.] 0x15d534 14.63% ceph-osd cep