Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Sage Weil
On Sat, 8 Feb 2014, Christian Balzer wrote: > On Fri, 7 Feb 2014 19:22:54 -0800 (PST) Sage Weil wrote: > > > On Sat, 8 Feb 2014, Christian Balzer wrote: > > > On Fri, 07 Feb 2014 18:46:31 +0100 Christian Kauhaus wrote: > > > > > > > Am 07.02.2014 14:42, schrieb Mark Nelson: > > > > > Ok, so the r

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Christian Balzer
On Fri, 7 Feb 2014 19:22:54 -0800 (PST) Sage Weil wrote: > On Sat, 8 Feb 2014, Christian Balzer wrote: > > On Fri, 07 Feb 2014 18:46:31 +0100 Christian Kauhaus wrote: > > > > > Am 07.02.2014 14:42, schrieb Mark Nelson: > > > > Ok, so the reason I was wondering about the use case is if you were >

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Sage Weil
On Sat, 8 Feb 2014, Christian Balzer wrote: > On Fri, 07 Feb 2014 18:46:31 +0100 Christian Kauhaus wrote: > > > Am 07.02.2014 14:42, schrieb Mark Nelson: > > > Ok, so the reason I was wondering about the use case is if you were > > > doing RBD specifically. Fragmentation has been something we've

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Christian Balzer
On Fri, 07 Feb 2014 18:46:31 +0100 Christian Kauhaus wrote: > Am 07.02.2014 14:42, schrieb Mark Nelson: > > Ok, so the reason I was wondering about the use case is if you were > > doing RBD specifically. Fragmentation has been something we've > > periodically kind of battled with but still see in

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Christian Kauhaus
Am 07.02.2014 14:42, schrieb Mark Nelson: > Ok, so the reason I was wondering about the use case is if you were doing RBD > specifically. Fragmentation has been something we've periodically kind of > battled with but still see in some cases. BTRFS especially can get pretty > spectacularly fragmen

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Mark Nelson
On 02/06/2014 01:41 PM, Christian Kauhaus wrote: Am 06.02.2014 16:24, schrieb Mark Nelson: Hi Christian, can you tell me a little bit about how you are using Ceph and what kind of IO you are doing? Sure. We're using it almost exclusively for serving VM images that are accessed from Qemu's buil

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-07 Thread Christian Kauhaus
Am 06.02.2014 16:24, schrieb Mark Nelson: > Hi Christian, can you tell me a little bit about how you are using Ceph and > what kind of IO you are doing? Just forgot to mention: we're running Ceph 0.72.2 on Linux 3.10 (both storage servers and inside VMs) and Qemu-KVM 1.5.3. Regards Christian --

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-06 Thread Christian Kauhaus
Am 06.02.2014 16:24, schrieb Mark Nelson: > Hi Christian, can you tell me a little bit about how you are using Ceph and > what kind of IO you are doing? Sure. We're using it almost exclusively for serving VM images that are accessed from Qemu's built-in RBD client. The VMs themselves perform a ver

Re: [ceph-users] filesystem fragmentation on ext4 OSD

2014-02-06 Thread Mark Nelson
On 02/06/2014 04:17 AM, Christian Kauhaus wrote: Hi, after running Ceph for a while I see a lot of fragmented files on our OSD filesystems (all running ext4). For example: itchy ~ # fsck -f /srv/ceph/osd/ceph-5 fsck von util-linux 2.22.2 e2fsck 1.42 (29-Nov-2011) [...] /dev/mapper/vgosd00-ceph-

[ceph-users] filesystem fragmentation on ext4 OSD

2014-02-06 Thread Christian Kauhaus
Hi, after running Ceph for a while I see a lot of fragmented files on our OSD filesystems (all running ext4). For example: itchy ~ # fsck -f /srv/ceph/osd/ceph-5 fsck von util-linux 2.22.2 e2fsck 1.42 (29-Nov-2011) [...] /dev/mapper/vgosd00-ceph--osd00: 461903/418119680 files (33.7% non-contiguou