[ceph-users] rbd striping

Hi there, I read about how striping of rbd works at http://ceph.com/docs/next/man/8/rbd/ and it seems rather complex to me. As the individual objects are placed randomly over all osds taking crush into account anyway, what's the benefit over simply calculating object_id = (position / chunk_siz

Re: [ceph-users] Fedora 18 Qemu

On 27.08.2013 22:20, Joe Ryner wrote: Does anyone have the best patches for Fedora 18 qemu that fixes aio issues? I have built my own but am having mixed results? Its qemu 1.2.2 Or would it be better to jump to Fedora 19. I am running Fedora 18 in hopes that RHEL 7 will be based on it. I

[ceph-users] Upgraded Bobtail to Cuttlefish and unable to mount cephfs

Hi, I upgraded Ceph from Bobtail to Cuttlefish and everything seemed good. Then I started to write to cephfs, but at some moment write stalled. After that I'm not able to mount either with kernel driver, or with custom utility. ceph -s shows that everything is good. health HEALTH_OK monmap e2:

[ceph-users] metadata server - single point of failure?

Dear list, from the Ceph documentation: "Note Currently Ceph runs in production with one metadata node only. You may use more, but there is currently no commercial support for a cluster with multiple metadata nodes." Is this not a SPOF? What happens if my metadata server goes down? How can I recov

[ceph-users] trouble with ceph-deploy

Hi. New trouble with ceph-deploy. When i'm executing: ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 ceph-deploy osd activate ceph001:sdaa:/dev/sda1 or ceph-deploy osd prepare ceph001:/dev/sdaa1:/dev/sda1 ceph-deploy osd activate ceph001:/dev/sdaa:/dev/sda1 OSD not created: ceph -k ceph.client.a

Re: [ceph-users] metadata server - single point of failure?

Hi Athanasios, CephFS is for most applications still considered pre-production, so do keep that in mind (IE we only provide paid support in very specific scenarios). Having said that, we should probably update these docs a bit. As far as I know, we are generally ok with multiple MDS servers

[ceph-users] radosgw-admin caps

Hi, So what am I doing wrong? As I read the docs (http://ceph.com/docs/master/radosgw/adminops/) i need users=read which I applied with the command, radosgw-admin caps add --uid=derek --caps="users=read" But when I try to access /admin/users I get the following in the radosgw.log and a 403 to

Re: [ceph-users] trouble with ceph-deploy

On Thu, Aug 29, 2013 at 8:00 AM, Pavel Timoschenkov < pa...@bayonetteas.onmicrosoft.com> wrote: > Hi. > New trouble with ceph-deploy. When i'm executing: > > ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 > ceph-deploy osd activate ceph001:sdaa:/dev/sda1 > or > ceph-deploy osd prepare ceph001:/de

Re: [ceph-users] metadata server - single point of failure?

Hi Mark, first of all thanks for the quick reply. Regarding multiple MDS servers in active-passive configuration, where do I find more information about that? As from where in the documentation I found the passage, it is right over there: http://ceph.com/docs/master/start/quick-ceph-deploy/ - in t

Re: [ceph-users] metadata server - single point of failure?

On 08/29/2013 03:39 PM, Athanasios Kostopoulos wrote: > To change the question and expand a bit: are there SPOFs in ceph's > design? How one can built a really robust ceph "cluster"? There are no SPOFs in ceph. Except for the fact that a ceph cluster likes to reside in one close geographic reg

[ceph-users] trouble with ceph-deploy

Hi. New trouble with ceph-deploy. When i'm executing: ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 ceph-deploy osd activate ceph001:sdaa:/dev/sda1 or ceph-deploy osd prepare ceph001:/dev/sdaa1:/dev/sda1 ceph-deploy osd activate ceph001:/dev/sdaa:/dev/sda1 OSD not created: ceph -k ceph.client.a

Re: [ceph-users] radosgw-admin caps

On Thu, Aug 29, 2013 at 6:35 AM, Derek Yarnell wrote: > Hi, > > So what am I doing wrong? As I read the docs > (http://ceph.com/docs/master/radosgw/adminops/) i need users=read which > I applied with the command, > > radosgw-admin caps add --uid=derek --caps="users=read" > > But when I try to a

Re: [ceph-users] trouble with ceph-deploy

Hi. If I use the example of the doc: http://ceph.com/docs/master/rados/deployment/ceph-deploy-osd/#create-osds ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 ceph-deploy osd activate ceph001:sdaa:/dev/sda1 or ceph-deploy osd prepare ceph001:/dev/sdaa1:/dev/sda1 ceph-deploy osd activate ceph001:/de

Re: [ceph-users] radosgw-admin caps

> You're not specifying which user you're trying to get info for. The > request needs extra 'uid' param that specifies the target user. Other > than that you're ok. > > Yehuda > Hi Yehuda, But the docs say I should get back a list of users if no uid is specified. http://ceph.com/docs/master

Re: [ceph-users] trouble with ceph-deploy

On Thu, Aug 29, 2013 at 10:23 AM, Pavel Timoschenkov < pa...@bayonetteas.onmicrosoft.com> wrote: > Hi. > > If I use the example of the doc: > http://ceph.com/docs/master/rados/deployment/ceph-deploy-osd/#create-osds* > *** > > ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 > ceph-deploy osd a

Re: [ceph-users] rbd striping

On 08/29/2013 09:57 AM, Corin Langosch wrote: Hi there, I read about how striping of rbd works at http://ceph.com/docs/next/man/8/rbd/ and it seems rather complex to me. As the individual objects are placed randomly over all osds taking crush into account anyway, what's the benefit over simply c

Re: [ceph-users] trouble with ceph-deploy

On Thu, 29 Aug 2013, Pavel Timoschenkov wrote: > > Hi. > New trouble with ceph-deploy. When i'm executing: > > ceph-deploy osd prepare ceph001:sdaa:/dev/sda1 > ceph-deploy osd activate ceph001:sdaa:/dev/sda1 > or > ceph-deploy osd prepare ceph001:/dev/sdaa1:/dev/sda1 > ceph-deploy osd activate ce

Re: [ceph-users] Issues setting up ceph object storage

On Wednesday, August 28, 2013, Gerd Jakobovitsch wrote: > Hello all, > > I am trying to install a ceph environment for testing, focused on block > devices for virtualization and object storage. I am facing some issues. > > My environment consists of one server running ceph-deploy and mon; 3 > clus

Re: [ceph-users] rbd striping

On Thursday, August 29, 2013, Corin Langosch wrote: > Hi there, > > I read about how striping of rbd works at http://ceph.com/docs/next/man/** > 8/rbd/ and it seems rather complex > to me. As the individual objects are placed randomly over all osds taking > c

Re: [ceph-users] rbd striping

The short answer is that if you use an approach like you suggest and then alter the cluster in any way (add a node or remove a node) then the ensuing re-balancing of data will move most of your data. CRUSH was designed to limit data movement in the case of cluster membership changes. Here's a

[ceph-users] Ceph Performance

I've setup ceph cluster and using rbd to check the performance. Used ceph-deploy for deployment. /dev/sdb - is data disk, /dev/sda4 - is journal. I've 2 servers running 2 osds and I 've 3 monitors running from vmware virtual machine. which has sufficient RAM/CPU. servers are dual core and i've 2

Re: [ceph-users] Ceph Performance

Hi! How much replication are you using? Also, what kind of disk is this? Was the 191MB/s number to one of the drives on one of the servers? You may also find that running concurrent dd's improve your numbers. Thanks, Mark On 08/29/2013 12:44 PM, raj kumar wrote: I've setup ceph cluster an

Re: [ceph-users] Ceph Performance

I've not changed any default configuration of ceph-deploy. I just added public/cluster network to config. rep size is 2. it's a sata disk. Yes. 191MB/s is from physical local disk. As you said running concurrent dd gives 94.1MB/s and 135 MB/s. So is it normal? I'm using ver version 0.67.1. O

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Mark and list, FYI for you and the list: Samuel and I seem to have found and fixed the remaining performance-problems. For those who can't wait, fixes are in "wip-dumpling-perf2" and will probably be in the next point-release. Regards, Oliver On 27-08-13 17:13, Mark Nelson wrote:

Re: [ceph-users] Ceph Performance

On 08/29/2013 01:26 PM, raj kumar wrote: I've not changed any default configuration of ceph-deploy. I just added public/cluster network to config. rep size is 2. it's a sata disk. Yes. 191MB/s is from physical local disk. That's pretty fast for most sata disks! As you said running concurr

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Excellent news! Btw, Sam mentioned you are using flashcache. Would you mind talking a little bit about what you are doing and what kind of performance you see? This is an area I've been wanting to explore but haven't found the time yet. Mark On 08/29/2013 01:52 PM, Oliver Daudey wrote: H

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Hey Mark, Sam must have mistaken me for someone else, as I'm not currently using any non-standard hardware- or software-assisted caching on any of the Ceph-clusters I manage. Regards, Oliver On do, 2013-08-29 at 13:56 -0500, Mark Nelson wrote: > Excellent news! > > Btw, Sam mentioned

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Oops! -Sam On Thu, Aug 29, 2013 at 2:00 PM, Oliver Daudey wrote: > Hey Mark, > > Sam must have mistaken me for someone else, as I'm not currently using > any non-standard hardware- or software-assisted caching on any of the > Ceph-clusters I manage. > > >Regards, > > Oliver > > On do, 2

Re: [ceph-users] Significant slowdown of osds since v0.67 Dumpling

Sam and Oliver, We've had tons of issues with Dumpling rbd volumes showing sporadic periods of high latency for Windows guests doing lots of small writes. We saw the issue occasionally with Cuttlefish, but it got significantly worse with Dumpling. Initial results with wip-dumpling-perf2 appear

[ceph-users] Ceph Supported by Citrix XenServer Yet?

Hi guys, Anyone heard anything if Citrix XenServer supports Ceph yet? Provision CentOS6.4 then on the top of it installing Xen seems a bit too much. Thanks! ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-

Re: [ceph-users] Ceph Supported by Citrix XenServer Yet?

The XenServer product has a tech preview version available with Ceph RBD support: http://xenserver.org/discuss-virtualization/virtualization-blog/entry/tech-preview-of-xenserver-libvirt-ceph.html The fully-supported, commercial version from Citrix will be available sometime in Q4. Neil On Thu

Re: [ceph-users] Issues setting up ceph object storage

On 08/29, Gregory Farnum wrote: > On Wednesday, August 28, 2013, Gerd Jakobovitsch wrote: > > > Hello all, > > > > I am trying to install a ceph environment for testing, focused on block > > devices for virtualization and object storage. I am facing some issues. > > > > My environment consists of