Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Stan Hoeppner
On 11/8/2011 7:50 AM, Peer Heinlein wrote: > I have > 11 TB hard used Mailstorage, saved als maildir in ext3 on HP EVA. That's a lot of mail (likely a large user base--not given), on a filesystem not designed for such, on a decent SAN controller--LUN RAID configuration not given. > I always want

Re: [Dovecot] v2.1.beta1 released

2011-11-08 Thread Stephan Bosch
On 11/8/2011 11:35 PM, Timo Sirainen wrote: http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz.sig Here's the first beta release of Dovecot v2.1. This version has already been tested quite a lot, so I'm not expecting any ma

[Dovecot] v2.1.beta1 released

2011-11-08 Thread Timo Sirainen
http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz.sig Here's the first beta release of Dovecot v2.1. This version has already been tested quite a lot, so I'm not expecting any major bugs. So please upgrade and see if you can

Re: [Dovecot] another sizeof tweak

2011-11-08 Thread Timo Sirainen
On Tue, 2011-11-08 at 18:46 +0200, Timo Sirainen wrote: > On 8.11.2011, at 18.43, Mike Abbott wrote: > > > Line 776 of > > dovecot-2.0.15/src/lib-storage/index/maildir/maildir-sync-index.c reads: > > memcmp(old_rec, &new_rec, sizeof(old_rec)) != 0) { > > Should that be sizeof(*old_rec)? >

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Eric Rostetter
Quoting Peer Heinlein : The problem is: You're running in problems with shared folders. You can't read your neighbors storage-engine from ldap. Yes, but I didn't have any shared folders, so it worked. Your milage may vary, as I said... :) -- Eric Rostetter The Department of Physics The Univ

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Peer Heinlein
Am Dienstag, 8. November 2011, 17:53:32 schrieb Eric Rostetter: > May not work for you, but... > > The way I did this when I migrated was to run two dovecot instances, and > have perdition software on a front-end (could be on the same machine > instead of a front-end, I just happen to have a fro

Re: [Dovecot] Dovecot alias and mailbox problem

2011-11-08 Thread Tom Hendrikx
On 08-11-11 19:34, Jeroen Grusewski wrote: > > Hi All, > > My Postfix / Dovecot / MySQL is running fine but I have the following issue: > > When I create the following mailboxes t...@example.com and te...@example.com > it is working fine. > I can create an alias te...@examples.com => te...@exam

[Dovecot] Dovecot alias and mailbox problem

2011-11-08 Thread Jeroen Grusewski
Hi All, My Postfix / Dovecot / MySQL is running fine but I have the following issue: When I create the following mailboxes t...@example.com and te...@example.com it is working fine. I can create an alias te...@examples.com => te...@example.com that is also working without a problem, only when

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Eric Rostetter
Quoting Peer Heinlein : It would be MUCH easier if Dovecot could read maildir: or mdbox: from LDAP attributes. In this case the whole migration process could be split up into groups. Unfortunately we have shared folders and I don't know a way to read the *remote* mailbox-format from LDAP... So h

Re: [Dovecot] another sizeof tweak

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 18.43, Mike Abbott wrote: > Line 776 of dovecot-2.0.15/src/lib-storage/index/maildir/maildir-sync-index.c > reads: > memcmp(old_rec, &new_rec, sizeof(old_rec)) != 0) { > Should that be sizeof(*old_rec)? Yep, looks like was fixed in v2.1 already. I'll fix it for v2.0 to

[Dovecot] another sizeof tweak

2011-11-08 Thread Mike Abbott
Line 776 of dovecot-2.0.15/src/lib-storage/index/maildir/maildir-sync-index.c reads: memcmp(old_rec, &new_rec, sizeof(old_rec)) != 0) { Should that be sizeof(*old_rec)?

Re: [Dovecot] Multiple Patitions with with mdbox

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 16.19, Peer Heinlein wrote: > Having > 10 TByte mailstore filesystem-checks takes too much time. > > At the moment we have four different partitions, but I don't like to set > symlinks or LDAP-flags to sort customers and their domains to there > individual mount-point. I'd like

Re: [Dovecot] dsync and zlib

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 16.36, Peer Heinlein wrote: > Will dsync also use zlib-compression when copying mails from one side to > another? As long as the zlib plugin is globally enabled and zlib_save setting is set. > Wouldn't this be a good way to compress existing mails? > > http://wiki2.dovecot.org

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 15.50, Peer Heinlein wrote: > At the moment I *need* more speed, we have too much waitI/O on the system > and I already used all other performance and tuning-tricks (separated cache, > noatime, fsync and all that stuff). A few more ideas for Maildir if you haven't done yet: -

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Jahnke-Zumbusch, Dirk
Hi there, >I never tried it, but it should be possible to provide the mail_location >from the user repsoitory (LDAP, SQL, whatever) Actually this works :-) Our userdb looks similar to: account1:xyz:000:000::/account1s/home/dir::userdb_mail=maildir:/account1s/home/dir/Maildir account2:xyz:000:00

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 16.03, Morten Stevens wrote: > We have switched our mailbox storage format from maildir to mdbox! > > Maildir is a disaster. (too many small files) After the migration to mdbox > the performance has improved significantly. > > Conclusion: mdbox is great and much better performa

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 16.16, Ralf Hildebrandt wrote: > * Morten Stevens : > >> We have switched our mailbox storage format from maildir to mdbox! > > I wonder how I can incrementally change over from Maildir to mdbox? > I can of course use dsync to mirror Maildir: to mdbox:, but how can I > make dove

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 16.34, Peer Heinlein wrote: >> I can of course use dsync to mirror Maildir: to mdbox:, but how can I >> make dovecot look at Maildir FIRST and (if that fails) at mdbox? (or >> vice versa). > > I wonder about that problem too. Even the last-last-last-quick sync would be > so much

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Ralf Hildebrandt
* Peer Heinlein : > Am Dienstag, 8. November 2011, 15:16:12 schrieb Ralf Hildebrandt: > > Hi, > > > I wonder how I can incrementally change over from Maildir to mdbox? > > If you have double diskspace: haha :) no. I thought of a per-user migration, that way I don't need extra space. -- Ralf

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Oliver Eales
On 08.11.2011 15:16, Ralf Hildebrandt wrote: > * Morten Stevens : > >> We have switched our mailbox storage format from maildir to mdbox! I never tried it, but it should be possible to provide the mail_location from the user repsoitory (LDAP, SQL, whatever) So you can keep your global config, and

[Dovecot] dsync and zlib

2011-11-08 Thread Peer Heinlein
Will dsync also use zlib-compression when copying mails from one side to another? Wouldn't this be a good way to compress existing mails? http://wiki2.dovecot.org/Plugins/Zlib says, there's no way to do that. But dsync should respect the zlib-Plugin... Peer -- Heinlein Professional Linux

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Peer Heinlein
Am Dienstag, 8. November 2011, 15:16:12 schrieb Ralf Hildebrandt: Hi, > I wonder how I can incrementally change over from Maildir to mdbox? If you have double diskspace: Just use "dsync mirror" in the background to prepare the change. After that it's just a short downtime to migrate incrementa

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Javier de Miguel Rodríguez
Other important thing to consider is message expunging. With mdbox you are "delaying" the I/O associated with deleting e-mails. We have a nightly cronjob that expunge messages from mdboxes. If you have en EVA (wich one? 4.400? 6.400? ) you also can consider RAID 1+0 or SSD for indexe

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Peer Heinlein
Am Dienstag, 8. November 2011, 15:15:39 schrieb Javier de Miguel Rodríguez: Hi, > If you have CPU to spare, consider using zlib with mdbox. You are > trading CPU power (cheap) to get fewer IOPS (IOPS count is expensive). Hey. This point is great. I hadn't realized that. Sure. zlib will sa

[Dovecot] Multiple Patitions with with mdbox

2011-11-08 Thread Peer Heinlein
Having > 10 TByte mailstore filesystem-checks takes too much time. At the moment we have four different partitions, but I don't like to set symlinks or LDAP-flags to sort customers and their domains to there individual mount-point. I'd like to work with mdbox:/mail/%d/%n to calculate the path

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Ralf Hildebrandt
* Morten Stevens : > We have switched our mailbox storage format from maildir to mdbox! I wonder how I can incrementally change over from Maildir to mdbox? I can of course use dsync to mirror Maildir: to mdbox:, but how can I make dovecot look at Maildir FIRST and (if that fails) at mdbox? (or vi

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Javier de Miguel Rodríguez
We are very happy with mdbox+zlib+ext4 + iSCSI SAN (HP Lefthand in our setup) If you have CPU to spare, consider using zlib with mdbox. You are trading CPU power (cheap) to get fewer IOPS (IOPS count is expensive). Mdbox has halved our backup windows (2,8 TB uncompressed mailboxes, 2 T

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Morten Stevens
On 08.11.2011 14:50, Peer Heinlein wrote: *) Is mdbox really faster? I'd like to have mdbox to have better performance in running my backup-processes. But does it bring some performance boosts to? Hi Peer, We have switched our mailbox storage format from maildir to mdbox! Maildir is a disas

Re: [Dovecot] Performance-Tuning

2011-11-08 Thread Ricardo Branco
What is the setup on the EVA, FC or iSCSI? Sent from my BlackBerry® wireless device -Original Message- From: Peer Heinlein Sender: dovecot-boun...@dovecot.org Date: Tue, 8 Nov 2011 14:50:25 To: Subject: [Dovecot] Performance-Tuning Hi, I have > 11 TB hard used Mailstorage, saved als

[Dovecot] Performance-Tuning

2011-11-08 Thread Peer Heinlein
Hi, I have > 11 TB hard used Mailstorage, saved als maildir in ext3 on HP EVA. I always wanted to make some mesurements about several influences to the performance (switch to ext4, switch to mdbox), but I never had enough time to do that. At the moment I *need* more speed, we have too much wa

Re: [Dovecot] Failing to share folders when listescape is enabled (2.0.14)

2011-11-08 Thread Timo Sirainen
On 8.11.2011, at 12.20, mailing lists wrote: > How I can share a folder with dots when the listescape plugin is enabled? Sorry, doesn't work in v2.0 and I don't think it's possible to fix it without major changes. Those major changes are done in v2.1 code tree though, and it works there.

[Dovecot] Failing to share folders when listescape is enabled (2.0.14)

2011-11-08 Thread mailing lists
Hello, How I can share a folder with dots when the listescape plugin is enabled? In this example user001 is sharing two foders named "docs-abc" and "docs-a.b.c" to user002. The first folder (without dots) is seen by user002 but the second is not found by dovecot because it search a system fo

Re: [Dovecot] Attachements with SIS : shauld all the same files share the same inode ?

2011-11-08 Thread Yann Dupont
Hi timo, thanks for your answer Le 05/11/2011 17:23, Timo Sirainen a écrit : On Mon, 2011-10-17 at 09:19 +0200, Yann Dupont wrote: 104 instance of -rw--- 104 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-ffd0d1 The files are hardlinked, so it seems ok, but