Re: [ceph-users] Btrfs defragmentation

2015-05-12 Thread Lionel Bouton
On 05/06/15 20:28, Lionel Bouton wrote: > Hi, > > On 05/06/15 20:07, Timofey Titovets wrote: >> 2015-05-06 20:51 GMT+03:00 Lionel Bouton : >>> Is there something that would explain why initially Btrfs creates the >>> 4MB files with 128k extents (32 extents / file) ? Is it a bad thing for >>> perfor

Re: [ceph-users] Btrfs defragmentation

2015-05-07 Thread Lionel Bouton
Hi, On 05/07/15 12:30, Burkhard Linke wrote: > [...] > Part of the OSD boot up process is also the handling of existing > snapshots and journal replay. I've also had several btrfs based OSDs > that took up to 20-30 minutes to start, especially after a crash. > During journal replay the OSD daemon

Re: [ceph-users] Btrfs defragmentation

2015-05-07 Thread Burkhard Linke
Hi, On 05/07/2015 12:04 PM, Lionel Bouton wrote: On 05/06/15 19:51, Lionel Bouton wrote: *snipsnap* We've seen progress on this front. Unfortunately for us we had 2 power outages and they seem to have damaged the disk controller of the system we are testing Btrfs on: we just had a system crash

Re: [ceph-users] Btrfs defragmentation

2015-05-07 Thread Lionel Bouton
On 05/06/15 19:51, Lionel Bouton wrote: > During normal operation Btrfs OSD volumes continue to behave in the same > way XFS ones do on the same system (sometimes faster/sometimes slower). > What is really slow though it the OSD process startup. I've yet to make > serious tests (umounting the file

Re: [ceph-users] Btrfs defragmentation

2015-05-06 Thread Lionel Bouton
Hi, On 05/06/15 20:07, Timofey Titovets wrote: > 2015-05-06 20:51 GMT+03:00 Lionel Bouton : >> Is there something that would explain why initially Btrfs creates the >> 4MB files with 128k extents (32 extents / file) ? Is it a bad thing for >> performance ? > This kind of behaviour is a reason why

Re: [ceph-users] Btrfs defragmentation

2015-05-06 Thread Lionel Bouton
Hi, On 05/06/15 20:04, Mark Nelson wrote: > [...] > Out of curiosity, do you see excessive memory usage during > defragmentation? Last time I spoke to josef it sounded like it wasn't > particularly safe yet and could make the machine go OOM, especially if > there are lots of snapshots. > We have

Re: [ceph-users] Btrfs defragmentation

2015-05-06 Thread Timofey Titovets
2015-05-06 20:51 GMT+03:00 Lionel Bouton : > On 05/05/15 02:24, Lionel Bouton wrote: >> On 05/04/15 01:34, Sage Weil wrote: >>> On Mon, 4 May 2015, Lionel Bouton wrote: Hi, we began testing one Btrfs OSD volume last week and for this first test we disabled autodefrag and began t

Re: [ceph-users] Btrfs defragmentation

2015-05-06 Thread Mark Nelson
On 05/06/2015 12:51 PM, Lionel Bouton wrote: On 05/05/15 02:24, Lionel Bouton wrote: On 05/04/15 01:34, Sage Weil wrote: On Mon, 4 May 2015, Lionel Bouton wrote: Hi, we began testing one Btrfs OSD volume last week and for this first test we disabled autodefrag and began to launch manual btrfs

Re: [ceph-users] Btrfs defragmentation

2015-05-06 Thread Lionel Bouton
On 05/05/15 02:24, Lionel Bouton wrote: > On 05/04/15 01:34, Sage Weil wrote: >> On Mon, 4 May 2015, Lionel Bouton wrote: >>> Hi, >>> >>> we began testing one Btrfs OSD volume last week and for this first test >>> we disabled autodefrag and began to launch manual btrfs fi defrag. >>> [...] >> Cool.

Re: [ceph-users] Btrfs defragmentation

2015-05-05 Thread Lionel Bouton
On 05/05/15 06:30, Timofey Titovets wrote: > Hi list, > Excuse me, what I'm saying is off topic > > @Lionel, if you use btrfs, did you already try to use btrfs compression for > OSD? > If yes, сan you share the your experience? Btrfs compresses by default using zlib. We force lzo compression inst

Re: [ceph-users] Btrfs defragmentation

2015-05-04 Thread Timofey Titovets
Hi list, Excuse me, what I'm saying is off topic @Lionel, if you use btrfs, did you already try to use btrfs compression for OSD? If yes, сan you share the your experience? 2015-05-05 3:24 GMT+03:00 Lionel Bouton : > On 05/04/15 01:34, Sage Weil wrote: >> On Mon, 4 May 2015, Lionel Bouton wrote:

Re: [ceph-users] Btrfs defragmentation

2015-05-04 Thread Lionel Bouton
On 05/04/15 01:34, Sage Weil wrote: > On Mon, 4 May 2015, Lionel Bouton wrote: >> Hi, >> >> we began testing one Btrfs OSD volume last week and for this first test >> we disabled autodefrag and began to launch manual btrfs fi defrag. >> [...] > Cool.. let us know how things look after it ages! We

Re: [ceph-users] Btrfs defragmentation

2015-05-03 Thread Lionel Bouton
On 05/04/15 01:34, Sage Weil wrote: > On Mon, 4 May 2015, Lionel Bouton wrote: >> Hi, we began testing one Btrfs OSD volume last week and for this >> first test we disabled autodefrag and began to launch manual btrfs fi >> defrag. During the tests, I monitored the number of extents of the >> journa

Re: [ceph-users] Btrfs defragmentation

2015-05-03 Thread Sage Weil
On Mon, 4 May 2015, Lionel Bouton wrote: > Hi, > > we began testing one Btrfs OSD volume last week and for this first test > we disabled autodefrag and began to launch manual btrfs fi defrag. > > During the tests, I monitored the number of extents of the journal > (10GB) and it went through the r