Re: [ceph-users] RBD write access patterns and atime

2014-04-17 Thread Mike Dawson
Thanks Dan! Thanks, Mike Dawson On 4/17/2014 4:06 AM, Dan van der Ster wrote: Mike Dawson wrote: Dan, Could you describe how you harvested and analyzed this data? Even better, could you share the code? Cheers, Mike First enable debug_filestore=10, then you'll see logs like this: 2014-04-1

Re: [ceph-users] RBD write access patterns and atime

2014-04-17 Thread Dan van der Ster
Christian Balzer wrote: > I'm trying to understand that distribution, and the best explanation > I've come up with is that these are ext4/xfs metadata updates, > probably atime updates. Based on that theory, I'm going to test > noatime on a few VMs and see if I notice a change in the distribu

Re: [ceph-users] RBD write access patterns and atime

2014-04-17 Thread Dan van der Ster
Mike Dawson wrote: Dan, Could you describe how you harvested and analyzed this data? Even better, could you share the code? Cheers, Mike First enable debug_filestore=10, then you'll see logs like this: 2014-04-17 09:40:34.466749 7fb39df16700 10 filestore(/var/lib/ceph/osd/osd.0) write 4.2

Re: [ceph-users] RBD write access patterns and atime

2014-04-17 Thread Dan van der Ster
Hi, Gregory Farnum wrote: I forget which clients you're using — is rbd caching enabled? Yes, the clients are qemu-kvm-rhev with latest librbd from dumpling and rbd cache = true. Cheers, Dan -- Dan van der Ster || Data & Storage Services || CERN IT Department -- ___

Re: [ceph-users] RBD write access patterns and atime

2014-04-16 Thread Somnath Roy
--Original Message- From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Christian Balzer Sent: Wednesday, April 16, 2014 5:43 PM To: Dan van der Ster Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] RBD write access patterns and atime On Wed,

Re: [ceph-users] RBD write access patterns and atime

2014-04-16 Thread Christian Balzer
On Wed, 16 Apr 2014 17:08:09 +0200 Dan van der Ster wrote: > Dear ceph-users, > > I've recently started looking through our FileStore logs to better > understand the VM/RBD IO patterns, and noticed something interesting. > Here is a snapshot of the write lengths for one OSD server (with 24 > O

Re: [ceph-users] RBD write access patterns and atime

2014-04-16 Thread Mark Nelson
On 04/16/2014 12:14 PM, Gregory Farnum wrote: On Wed, Apr 16, 2014 at 8:08 AM, Dan van der Ster wrote: Dear ceph-users, I've recently started looking through our FileStore logs to better understand the VM/RBD IO patterns, and noticed something interesting. Here is a snapshot of the write lengt

Re: [ceph-users] RBD write access patterns and atime

2014-04-16 Thread Mike Dawson
Dan, Could you describe how you harvested and analyzed this data? Even better, could you share the code? Cheers, Mike On 4/16/2014 11:08 AM, Dan van der Ster wrote: Dear ceph-users, I've recently started looking through our FileStore logs to better understand the VM/RBD IO patterns, and not

Re: [ceph-users] RBD write access patterns and atime

2014-04-16 Thread Gregory Farnum
On Wed, Apr 16, 2014 at 8:08 AM, Dan van der Ster wrote: > Dear ceph-users, > > I've recently started looking through our FileStore logs to better > understand the VM/RBD IO patterns, and noticed something interesting. Here > is a snapshot of the write lengths for one OSD server (with 24 OSDs) --