Re: [Dovecot] Compressing existing maildirs

2012-01-03 Thread Timo Sirainen
On 31.12.2011, at 9.54, Stan Hoeppner wrote: > Timo, is there any technical or sanity based upper bound on mdbox size? > Anything wrong with using 64MB, 128MB, or even larger for > mdbox_rotate_size? Should be fine. The only issue is the extra disk I/O required to recreate the files during dovea

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Stan Hoeppner
On 12/31/2011 12:56 AM, Jan-Frode Myklebust wrote: > On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: >> >> Roger that. Good strategy. You using SAN storage or local RAID? What >> filesystem do you plan to use for the new mailbox location? What OS is >> the Dovecot host? > > IBM

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Jan-Frode Myklebust
On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: > > Roger that. Good strategy. You using SAN storage or local RAID? What > filesystem do you plan to use for the new mailbox location? What OS is > the Dovecot host? IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Stan Hoeppner
On 12/30/2011 8:41 AM, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: >>> We just got rid of the legacy app that worked directly against the >>> maildirs, which is the reason we now can turn on compression. I >>> intend to switch to mdbox, but first I ne

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: > > We just got rid of the legacy app that worked directly against the > > maildirs, which is the reason we now can turn on compression. I > > intend to switch to mdbox, but first I need to free up some disks by > > compressing the exis

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 03:48:05PM +0200, Timo Sirainen wrote: > > > > Can't I trust that no mails with timestamp before I enabled compression > > are uncompressed? Or will dovecot compress old messages keeping old > > timestamp when copying messages between folders, or something like that? > > I

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Timo Sirainen
On 29.12.2011, at 15.36, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: >>> >>> I.e. find all maildir-files: >>> >>> - with size in the name ("*,S=*") >>> - modified before I enabled zlib plugin >> >> As long as it doesn't find any already co

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: > > > > I.e. find all maildir-files: > > > > - with size in the name ("*,S=*") > > - modified before I enabled zlib plugin > > As long as it doesn't find any already compressed mails.. Can't I trust that no mails with timest

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Stan Hoeppner
On 12/29/2011 2:49 AM, Jan-Frode Myklebust wrote: > On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: >> The cleanest (though not necessarily simplest) way to go about this would be >> to use dsync to create a new maildir and incrementally direct traffic to a >> separate Dovecot instan

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Timo Sirainen
On 24.12.2011, at 17.20, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: > The cleanest (though not necessarily simplest) way to go about this would be > to use dsync to create a new maildir and incrementally direct traffic to a > separate Dovecot instance. > > Unless you have a legacy application that reli

Re: [Dovecot] Compressing existing maildirs

2011-12-28 Thread Dovecot-GDH
The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. I expect

[Dovecot] Compressing existing maildirs

2011-12-24 Thread Jan-Frode Myklebust
I've just enabled zlib for our users, and am looking at how to compress the existing files. The routine for doing this at http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do you think about simply doing: find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6