Fw: new message

2015-10-27 Thread Jan-Frode Myklebust
Hey! New message, please read <http://plrpictures.com/live.php?6n3> Jan-Frode Myklebust

Re: [Dovecot] Zlib plugin - when does it make sense?

2013-11-25 Thread Jan-Frode Myklebust
On Mon, Nov 25, 2013 at 02:47:33PM +0100, Frerich Raabe wrote: > > Interesting! What zlib compression level did you use? I figure even low > levels would work rather well for plain text. plugin { zlib_save_level = 6 # 1..9 zlib_save = gz # or bz2 }

Re: [Dovecot] Zlib plugin - when does it make sense?

2013-11-25 Thread Jan-Frode Myklebust
On Mon, Nov 25, 2013 at 09:53:14AM +0100, Frerich Raabe wrote: > > I run a small IMAP server for a dozen guys in the office, serving > about 55GB of Maildir. I recently became aware of the Zlib plugin ( > http://wiki2.dovecot.org/Plugins/Zlib ) and wondered > > 1. given that there is about zero C

Re: [Dovecot] highly available userdb

2013-11-18 Thread Jan-Frode Myklebust
On Wed, Nov 13, 2013 at 01:52:09PM +1000, Nick Edwards wrote: > On 11/12/13, Jan-Frode Myklebust wrote: > > My installation is only serving 1/10 of your size, but long time ago we > > migrated off mysql for userdatabase, and over to LDAP. The MySQL data > > source had issues

Re: [Dovecot] highly available userdb (Was: Re Dovecot MTA)

2013-11-11 Thread Jan-Frode Myklebust
My installation is only serving 1/10 of your size, but long time ago we migrated off mysql for userdatabase, and over to LDAP. The MySQL data source had issues (not dovecot related), and didn't seem like the right tool for the job. Initially we kept mysql as the authoritative database over our use

Re: [Dovecot] server side private/public key

2013-11-11 Thread Jan-Frode Myklebust
Serverside private key probably doesn't protect against much, but a way for users to upload a public key and automatically encrypt all messages when received might have value. Limits exposure for messages at rest. -jf > Den 11. nov. 2013 kl. 15:21 skrev Peter Mogensen : > > *Christian Fels

Re: [Dovecot] Dovecot MSA -> MTA

2013-11-11 Thread Jan-Frode Myklebust
On Sun, Nov 10, 2013 at 12:59:27AM +0100, Reindl Harald wrote: > > everywhere else you have sender-dependent relay hosts, RCPT dependent > relayhosts > and all sort of aliases which you *do not* want treated different between > incoming mail from outside or a internal server and submission mail >

Re: [Dovecot] Dovecot MTA

2013-11-11 Thread Jan-Frode Myklebust
On Fri, Nov 08, 2013 at 04:22:13PM +0100, Timo Sirainen wrote: > > Ah, I had actually been mostly just thinking about inbound SMTP features. > It should of course support outbound SMTP as well, but I’m less familiar > about what functionality would be useful for that. Outbound is mostly the same

Re: [Dovecot] mdbox - healthy rotation size vs default

2013-08-26 Thread Jan-Frode Myklebust
On Mon, Aug 26, 2013 at 03:31:20PM -0400, Charles Marcus wrote: > >On 2013-08-26 2:58 PM, Michael Grimm wrote: > >>As a very rough estimate I do estimate a 5% waste of space > >>regarding deleted messages. But, my handful users are very > >>disciplined in purging their deleted messages on a regula

Re: [Dovecot] Dovecot tuning for GFS2

2013-08-25 Thread Jan-Frode Myklebust
On Thu, Aug 22, 2013 at 08:57:40PM -0500, Stan Hoeppner wrote: > > > 130m to 18m is 'only' a 7 fold decrease. 18m inodes is still rather > large for any filesystem, cluster or local. A check on an 18m inode XFS > filesystem, even on fast storage, would take quite some time. I'm sure > it would

Re: [Dovecot] mdbox - healthy rotation size vs default

2013-08-25 Thread Jan-Frode Myklebust
On Sat, Aug 24, 2013 at 10:47:56AM +0200, Michael Grimm wrote: > > I am running "mdbox_rotate_size = 100m" for approx. a year now on > a small server (a handful of users, only). All mailboxes are around > 1G each with a lot of attachments. I never had an issue so far. How much space are your mdbo

Re: [Dovecot] Dovecot tuning for GFS2

2013-08-21 Thread Jan-Frode Myklebust
On Wed, Aug 21, 2013 at 02:18:52PM +0200, Andrea gabellini - SC wrote: > > So you are using the same config I'm testing. I forgot to write that I > use maildir. I would strongly suggest using mdbox instead. AFAIK clusterfs' aren't very good at handling many small files. It's a worst case random I

Re: [Dovecot] The docs a re a bit weird on "Directory hashing"

2013-08-11 Thread Jan-Frode Myklebust
On Fri, Aug 09, 2013 at 12:02:34AM +0300, Eliezer Croitoru wrote: > > > > I use: > > > > mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln > "R" what for?? > I do understand a Lower case on the names and have seen the effect but > how would R be helpful?? > According to http://wiki2.dovecot.org/V

Re: [Dovecot] The docs a re a bit weird on "Directory hashing"

2013-08-08 Thread Jan-Frode Myklebust
On Thu, Aug 08, 2013 at 01:42:43AM +0300, Eliezer Croitoru wrote: > > And means a two layers cache of max 16 directories on the first layer > and 256 directories on the second layer. > The above allows millions of files storage and can benefit from all ext4 > lower kernel levels of compatibly rath

Re: [Dovecot] Dovecot never release preallocated space in mdbox

2013-07-29 Thread Jan-Frode Myklebust
On Mon, Jul 29, 2013 at 11:48:00AM +0200, Stéphane BERTHELOT wrote: > > mdbox_rotate_size = 128M > mdbox_rotate_interval = 1d > mdbox_preallocate_space = yes > On mailboxes patterns with low incoming mail (< 100kb / day) this > would waste much space. Of course I can decrease rotate size a lot >

Re: [Dovecot] convert to mdbox

2013-07-29 Thread Jan-Frode Myklebust
On Tue, Jul 23, 2013 at 10:08:57AM +0300, Birta Levente wrote: > > How can I convert all virtual mailboxes from maildir to mdbox? > Manually, one by one, working, but I have a lot ... I've converted around 4-500.000 users from maildir to mdbox by the following on a server configured for using MDB

Re: [Dovecot] login_trusted_networks from webmail ?

2013-07-12 Thread Jan-Frode Myklebust
On Thu, Jul 04, 2013 at 08:51:47PM +0200, Benny Pedersen wrote: > Timo Sirainen skrev den 2013-07-03 22:34: > > >If backend has login_trusted_networks pointing to directors, then the > >IP gets forwarded to backends as well. > > how does imap get ip from http ? The webmail-server will use the HT

Re: [Dovecot] login_trusted_networks from webmail ?

2013-07-03 Thread Jan-Frode Myklebust
On Wed, Jul 03, 2013 at 11:34:56PM +0300, Timo Sirainen wrote: > > a ID ("x-originating-ip" "1.2.3.4") Perfect, thanks! Feature request for SOGo filed: http://www.sogo.nu/bugs/view.php?id=2366 -jf

[Dovecot] login_trusted_networks from webmail ?

2013-07-03 Thread Jan-Frode Myklebust
I'd like to get the IP-address of the webmail-klient logged in my maillog (for being compliant with coming data retention policies). I've noticed that with login_trusted_networks pointing at my dovecot directors, we get rip=client-ip logged on the backends. How is the proxy providing this to the do

Re: [Dovecot] Dovecot + SELinux permission problems

2013-06-23 Thread Jan-Frode Myklebust
On Sun, Jun 23, 2013 at 04:21:17PM +0100, Johnny wrote: > > I had thought SELinux would log something, but /var/log/audit/audit.log > is blank... Are you running auditd? I believe that if you're not running auditd, the denials should be logged to the kernel ring buffer. Does "dmesg" show any deni

[Dovecot] valid folder name

2013-06-08 Thread Jan-Frode Myklebust
We have a quite large user base, with lots of bad folder names because the mail folders was earlier accessible outside of dovecot. Now we're running dsync conversions from maildir to mdbox for all users, but are struggelig a bit with dsync not liking invalid folder names. Before we convert a user

Re: [Dovecot] Administrative mailbox deletions

2013-06-04 Thread Jan-Frode Myklebust
On Tue, Jun 04, 2013 at 11:58:50AM +0100, Alan Brown wrote: > > > One user has named all his mailboxes with leading hyphens. > > ie: > > -foo > -bar > -bazz > Does anyone have the magic sauce needed to escape the - character? No idea what you've tried, but maybe '--' is enough? dovea

Re: [Dovecot] Please clarify one point for me on director userdb (Was: Configuration advice needed.)

2013-06-03 Thread Jan-Frode Myklebust
On Mon, Jun 03, 2013 at 03:47:08PM +0200, Olivier Girard wrote: > I'm trying to finish my dovecot setup but things are unclear for me. > > I want director proxying mapping to same server for LMTP and POP/IMAP > connections. My authdb is LDAP and LMTP user are queried with mail > adress (ldap mail

[Dovecot] Bad exit status from dsync

2013-06-03 Thread Jan-Frode Myklebust
I just tried to migrate one of my users from maildir to mdbox using dsync. My conversion script is checking the dsync exit code to know if the conversion goes fine or not, and surprisingly dsync returned "0" at the same time as it gave the error: Error: Failed to sync mailbox .ta\ vare\ p

Re: [Dovecot] dovecot stats

2013-05-08 Thread Jan-Frode Myklebust
Thanks, nice graphs. I've attached a graph over LMTP delays per minute as seen from the postfix side on one of our servers. This includes delays caused by both delivery to dovecot LMTP, and also LMTP communication internally on the mailservers between postfix and amavis. Unfortunately it says nothi

Re: [Dovecot] dovecot stats

2013-05-08 Thread Jan-Frode Myklebust
On Mon, May 6, 2013 at 4:37 PM, Timo Sirainen wrote: > On 29.4.2013, at 15.30, Jan-Frode Myklebust wrote: > > > > Is it possible to collect info about POP3 and LMTP commands also ? > > No. I think they would be pretty boring statistics, since with POP3 pretty > much eve

Re: [Dovecot] Mail deduplication

2013-04-30 Thread Jan-Frode Myklebust
Wasn't there also some issue with cleanup of attachments ? Not being able to delete the last copy, or something. I did some testing of using SIS on a backup dsync destination a year (or two) ago, and got quite confused.. Don't quite remember the problems I had, but I did lose confidence in it and d

[Dovecot] dovecot stats

2013-04-29 Thread Jan-Frode Myklebust
I just upgraded one of our servers to dovecot v2.1.16 (ee), and am looking into the stats feature. Am I interpreting the wiki correct in reading that the "doveadm stats dump command" only returns statistics about IMAP commands? Is it possible to collect info about POP3 and LMTP commands also ? Al

Re: [Dovecot] Migration from v1 to v2 with hashed directory structure

2013-03-05 Thread Jan-Frode Myklebust
On Thu, Feb 28, 2013 at 02:59:52PM +0100, Pavel Dimow wrote: > > we have /var/spool/vmail/mydomain.com/u...@mydomain.com and I want a > new server with version 2 to have > hashed directory structure like /var/spool/vmail/mydomain.com/u/s/user > I was wondering it f there is some better solution t

Re: [Dovecot] lmtp-proxying in 2.1 slower than in 2.0.14 ?

2013-02-05 Thread Jan-Frode Myklebust
I think there must be some bug I'm hitting here. One of my directors is still running with "client_limit = 1, process_limit = 100" for the lmtp service, and now it's logging: master: Warning: service(lmtp): process_limit (100) reached, client connections are being dropped Checking "sudo netsta

Re: [Dovecot] lmtp-proxying in 2.1 slower than in 2.0.14 ?

2013-02-02 Thread Jan-Frode Myklebust
On Fri, Feb 1, 2013 at 11:00 PM, Timo Sirainen wrote: > On 1.2.2013, at 19.00, Jan-Frode Myklebust wrote: > > Have you checked if there's an increase in disk I/O usage, or system cpu > usage? > On the directors, cpu usage, and load averages seems to have gone down by

[Dovecot] lmtp-proxying in 2.1 slower than in 2.0.14 ?

2013-02-01 Thread Jan-Frode Myklebust
We upgraded our two dovecot directors from v2.0.14 to dovecot-ee 2.1.10.3 this week, and after that mail seems to be flowing a lot slower than before. The backend mailstores are untouched, on v2.0.14 still. After the upgrade we've been hitting process_limit for lmtp a lot, and we're struggeling wit

Re: [Dovecot] Help Regarding Multiple Base DN

2012-12-28 Thread Jan-Frode Myklebust
Just checked the Variables documentation http://wiki2.dovecot.org/Variables, which says: %D - return "sub.domain.org" as "sub,dc=domain,dc=org" (for LDAP queries) so it seems* you should be able to use "base = %D" [*] assuming the wiki meant to say "dc=sub,dc=domain,dc=org" -jf

Re: [Dovecot] Help Regarding Multiple Base DN

2012-12-28 Thread Jan-Frode Myklebust
Don't know if having multiple Base DNs can work, but you can use %variables in it. We use this one to be able to have a simple onelevel scope on all lookups: base = ou=people,o=%d,o=ISP,o=example,c=com scope = onelevel -jf

Re: [Dovecot] Mixing v2.1 and 2.0 directors ?

2012-12-28 Thread Jan-Frode Myklebust
On Fri, Dec 28, 2012 at 2:02 AM, Timo Sirainen wrote: > > The new v2.1 director code can handle running with old v2.1 directors (there > were some protocol changes that improve things). I think v2.0 director is > protocol compatible with the old v2.1 directors, so I think in theory it > should

[Dovecot] Mixing v2.1 and 2.0 directors ?

2012-12-27 Thread Jan-Frode Myklebust
I'm preparing to set up a new set of directors on dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. Will it be OK to set up a ring of directors with 2x dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? -jf

Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive

2012-11-13 Thread Jan-Frode Myklebust
On Mon, Nov 12, 2012 at 12:33 PM, Timo Sirainen wrote: > Hi all, > > Dovecot Oy’s web pages at www.dovecot.fi have been updated. The products page > lists two features that will be available for commercial licensing, extending > the functionality of the basic open-source version of Dovecot. > >

Re: [Dovecot] LMTP benefit vs LDA

2012-11-03 Thread Jan-Frode Myklebust
On Sat, Nov 3, 2012 at 10:45 AM, Davide wrote: > Hi to all, > my question is what is benefit implementing LMTP service replacing LDA i > have dovecot 2.1.8 with vpoipmail+qmail and about 500 users now i'm using > LDA and i'm interested on LMTP service. > Thanks in advance For us it has the benef

Re: [Dovecot] POLL: v2.2 to allow one mail over quota?

2012-10-29 Thread Jan-Frode Myklebust
+1 Better to be lenient, than to confuse users by accepting some but not other messages. I believe most larger mail providers has a max message size of around 64MB or less, so allowing the final message to exceed quota by about that sounds reasonable to me. -jf

Re: [Dovecot] trash plugin not doing it's job

2012-10-21 Thread Jan-Frode Myklebust
On Sat, Oct 20, 2012 at 3:51 PM, Daniel Parthey wrote: > Jan-Frode Myklebust wrote: >> $ cat /etc/dovecot/dovecot-trash.conf.ext >> # Spam mailbox is emptied before Trash >> 1 INBOX.Spam >> # Trash mailbox is emptied before Sent >> 2 INBOX.Trash > > Are yo

[Dovecot] trash plugin not doing it's job

2012-10-18 Thread Jan-Frode Myklebust
I enabled the trash plugin yesterday, adding "trash" to mail_plugins, and configuring the plugin setting "trash = /etc/dovecot/dovecot-trash.conf.ext". But I still see users with lots of files in INBOX.Trash getting bounced because of quota exceeded: postfix/lmtp[26273]:: C89F490061: to=, rela

[Dovecot] trash plugin together with sieve_before ?

2012-09-18 Thread Jan-Frode Myklebust
We have a sieve script doing sieve_before to sort spam to spam-folders. Now I'm trying to configure the "Trash" plugin, but it doesn't seem to work.. I noticed my config file says: # Space separated list of plugins to load (none known to be useful so far). Do NOT # try to load IMAP plugins her

Re: [Dovecot] Dovecot performance under high load (vs. Courier)

2012-06-25 Thread Jan-Frode Myklebust
On Thu, Jun 21, 2012 at 11:44:33PM +0300, Timo Sirainen wrote: > > > > additionally you should install imapproxy on the webserver > > wehre your webmail is running and configure the webmail for > > using 127.0.0.1 - so only one connection per user is > > persistent instead make a new one for each

Re: [Dovecot] Problem with lmtp director proxy

2012-06-12 Thread Jan-Frode Myklebust
On Tue, Jun 12, 2012 at 12:23:28PM +0200, Angel L. Mateo wrote: > I have two director servers directing to 4 backend servers. Which dovecot version are you running on your directors and backends? We're running 2.0.14 plus the below linked patches and have not since this problem since applying the

Re: [Dovecot] best practises for mail systems

2012-06-06 Thread Jan-Frode Myklebust
On Tue, Jun 05, 2012 at 11:59:47PM +1100, Костырев Александр Алексеевич wrote: > > I'm more worried about right design of mailstorage.. should I use some > cluster fs with all mail of all users > or should I split mailstorage across servers and somehow avoid long downtime > if one of servers goe

Re: [Dovecot] migrate 15K users to new domain name

2012-04-21 Thread Jan-Frode Myklebust
On Thu, Apr 19, 2012 at 05:59:39PM +0300, Timo Sirainen wrote: > > With v2.1.4 you could do something like: > > doveadm -c dummy.conf user -m user@domain > > where dummy.conf contains the minimum configuration needed: > > mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln > ssl = no > Thanks! Works

Re: [Dovecot] Configuration advices for a 50000 mailboxes server(s)

2012-04-21 Thread Jan-Frode Myklebust
On Thu, Apr 19, 2012 at 07:31:13PM -0500, Stan Hoeppner wrote: > > This issue has come up twice on the Postfix list in less than a month. Oh, thanks! I'll look into those list posts.. I had mostly given up solving this by rate limits and decided to throw hardware at the problem when I saw the lo

Re: [Dovecot] migrate 15K users to new domain name

2012-04-19 Thread Jan-Frode Myklebust
On Thu, Apr 19, 2012 at 05:03:01PM +0300, Odhiambo Washington wrote: > > > > In my setup, I have virtual users. So the home directory is in the > /var/spool/virtual/$domain/$user/mdbox > > How is yours setup? mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln > If the domain name changed, from

Re: [Dovecot] migrate 15K users to new domain name

2012-04-19 Thread Jan-Frode Myklebust
On Thu, Apr 19, 2012 at 02:01:44PM +0300, Odhiambo Washington wrote: > > What do you mean by a "new domain" in this context? The user's email addresses are changing from username@old.domain to username@new-domain. > Is the server changing? No. > Is the storage changing? The user's home direct

[Dovecot] migrate 15K users to new domain name

2012-04-19 Thread Jan-Frode Myklebust
I need to migrate 15K users to a new domain name, and plan to use "dsync mirror" in the transition phase. Could someone confirm that this should work: Before giving users access to new-domain do a first sync to get all the stale data over: for user in $old-domain; do dsync

Re: [Dovecot] Configuration advices for a 50000 mailboxes server(s)

2012-04-17 Thread Jan-Frode Myklebust
On Tue, Apr 17, 2012 at 10:10:02AM -0300, Mauricio López Riffo wrote: > > 1M = 1 milion ? 976508 to be exact :-) but it's very much a useless number. Lots and lots of these are inactive. A better number is probably that we're seeing about 80 logins/second for the last hour.. (just checked now, no

Re: [Dovecot] Configuration advices for a 50000 mailboxes server(s)

2012-04-17 Thread Jan-Frode Myklebust
On Tue, Apr 17, 2012 at 08:54:15AM -0300, Mauricio López Riffo wrote: > > Here we have approx. 200K users with 4000 concurrent connections > (90% POP3 users) How do you measure "concurrent" POP3 users? > All servers in virtual environment Vmware, > supermicro servers and Netapp Metrocluster

Re: [Dovecot] Better to use a single large storage server or multiple smaller for mdbox?

2012-04-14 Thread Jan-Frode Myklebust
On Fri, Apr 13, 2012 at 07:33:19AM -0500, Stan Hoeppner wrote: > > > > What I meant wasn't the drive throwing uncorrectable read errors but > > the drives are returning different data that each think is correct or > > both may have sent the correct data but one of the set got corrupted > > on the

Re: [Dovecot] Bug tracker

2012-04-11 Thread Jan-Frode Myklebust
On Wed, Apr 11, 2012 at 09:49:18AM +0300, Timo Sirainen wrote: > > > > I didn't see open source as a requirement, so then I would give a plug > > for Jira, which is the nicest/prettiest thing :-) > > I don't think it supports one of my requirements: > > > I would have the option of adding a comm

Re: [Dovecot] Bug tracker

2012-04-10 Thread Jan-Frode Myklebust
On Wed, Apr 11, 2012 at 09:26:20AM +0300, Timo Sirainen wrote: > > So, any suggestions for what software could do these things? I think Request > Tracker has those features, but it's not really the nicest/prettiest thing. > I didn't see open source as a requirement, so then I would give a plug

Re: [Dovecot] Need fast Maildir to mdbox conversion

2012-03-28 Thread Jan-Frode Myklebust
On Wed, Mar 28, 2012 at 12:40 AM, Jeff Gustafson wrote: >        I looked around the 'Net to see if there might be a custom program for > offline Maildir to mdbox conversion. So far I haven't turned up > anything. The problem for us is that the dsync program simply takes a > lot of time to convert

[Dovecot] doveadm purge on clusterfs

2012-03-27 Thread Jan-Frode Myklebust
Since doveadm service proxying apparently doesn't work with dovecot v2.0, we need to find a way to safely run doveadm purge on the host the user is logged into. Would it be OK to run purge in the pop/imap postlogin scripts? We already do a conditional: test /var/log/activemailaccounts/imap/$USER

Re: [Dovecot] dsync redesign

2012-03-24 Thread Jan-Frode Myklebust
On Sat, Mar 24, 2012 at 08:19:48AM +0100, Attila Nagy wrote: > On 03/23/12 22:25, Timo Sirainen wrote: > > > Well, dsync is a very useful tool, but with continuous replication > it tries to solve a problem which should be handled -at least > partially- elsewhere. Storing stuff in plain file systems

Re: [Dovecot] Creating an IMAP repo for ~100 users need some advice

2012-03-18 Thread Jan-Frode Myklebust
On Sun, Mar 18, 2012 at 11:36:25AM -0400, Charles Marcus wrote: > > Hmmm... wonder if there would be a way to add some kind of 'dummy' > first message that dovecot would simply ignore (not show to the > user), that would prevent that bevaior? That's what uw-imap does. It creates a message with th

Re: [Dovecot] POP3 Performance

2012-03-16 Thread Jan-Frode Myklebust
One quick fix to try, if it's the login-time that's killing you, is to enable auth caching: http://wiki2.dovecot.org/Authentication/Caching that should offload your backend LDAP-servers from doing bind() on ever login, had a huge login performance impact for us. We use "auth_cache_size =

Re: [Dovecot] OT: Distrowars - WAS: Re: seeking advice: dovecot versions; mailbox formats.

2012-03-09 Thread Jan-Frode Myklebust
On Thu, Mar 08, 2012 at 11:04:14AM -0500, Charles Marcus wrote: > > As for what mailbox format, there is no more 'dbox', it is either > sdbox (like mbox one file per folder) or mdbox (multiple files per > folder) - Sdbox is like maildir, one message per file, while mdbox is more like mbox:

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Jan-Frode Myklebust
On Mon, Mar 05, 2012 at 12:45:26PM +0200, Timo Sirainen wrote: > > > > So, ideally (for us), dovecot should keep a log over which accounts are > > active (has received or checked mail), and only sync users that has been > > active for the last $timeperiode on startup. > > Well, all of this could

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Jan-Frode Myklebust
On Sun, Mar 04, 2012 at 01:38:14PM +0200, Timo Sirainen wrote: > > > > Great news. I would love to test it, if I will be able to run this on a > > test > > account, only. All other users should become synced the "old way" for the > > time > > being. > > > > Would that be possible with the cu

[Dovecot] fts size

2012-02-28 Thread Jan-Frode Myklebust
Does anybody have any numbers for how large storage one will need for the fts indexing server? I see the wiki says 30% of mailbox size for Squat (partial=4 full=4). Is it similar for lucene/solr? Do I understand correctly if I think http://wiki2.dovecot.org/Plugins/FTS/Lucene will create an inde

Re: [Dovecot] Multiple locations, 2 servers - planning questions...

2012-02-27 Thread Jan-Frode Myklebust
On Mon, Feb 27, 2012 at 02:51:54PM -0600, l...@airstreamcomm.net wrote: > > You could also look at GPFS > (http://www-03.ibm.com/systems/software/gpfs/), which is not open source > but it's apparently rock solid and I believe supports multisite clustering. GPFS supports different modes of cluster

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-22 Thread Jan-Frode Myklebust
On Wed, Feb 22, 2012 at 09:31:55AM +, Ed W wrote: > > It seems intuitive that the proxy installed locally could save you > 2x RTT increment, which is about 0.8ms in your case. So I might > expect the proxy to reduce rendering times by around 1.6ms simply > because it reduces the number of rou

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-22 Thread Jan-Frode Myklebust
On Tue, Feb 21, 2012 at 02:33:24PM +, Ed W wrote: > > I think the original question was still sensible. In your case it > seems like the ping times are identical between: > webmail -> imap-proxy > webmail -> imap server > > I think your results show that a proxy has little (or negati

Re: [Dovecot] Homedir vs locations vs mail_location?

2012-02-20 Thread Jan-Frode Myklebust
On Mon, Feb 20, 2012 at 09:57:15AM +0300, Alexander Chekalin wrote: > > 1. The homedir value points to the place where everything for the > user stored at, while mail_location is something (some place) where > mail stored at. if I deal with pure virtual users (all users are in > sql tables and no

Re: [Dovecot] Any possibility of running query after sucessful login?

2012-02-16 Thread Jan-Frode Myklebust
On Thu, Feb 16, 2012 at 12:18:15PM +0100, Jacek Osiecki wrote: > > By the way, is such thing possible for other processess? For > example, I'd like to set in mysql table information that mail has > been delivered using lmtp. Would something like this work? > > protocol lmtp { > mail_plugins = $

Re: [Dovecot] Any possibility of running query after sucessful login?

2012-02-16 Thread Jan-Frode Myklebust
On Thu, Feb 16, 2012 at 09:41:52AM +0100, Jacek Osiecki wrote: > > I was just wondering if there is any possibility of running another > query after successful login - just to fill some extra field like > "last_login"? We touch a file in /var/log/activemailaccounts/$username on every successful

Re: [Dovecot] pop3 not autocreating directory structure

2012-02-15 Thread Jan-Frode Myklebust
On Wed, Feb 15, 2012 at 03:49:21AM +0200, Timo Sirainen wrote: > > > > Looking at the timestamps in the filesystem I see that the users home > > directory wasn't created before switcing to imap. > > > > Is this a know problem? > > Probably again a bug in your specific Dovecot version. :) I reme

[Dovecot] doveadm director proxy

2012-02-14 Thread Jan-Frode Myklebust
I'm trying to configure a doveadm service that will proxy trough our directors, following the recipie at: http://wiki2.dovecot.org/Director#Doveadm_server So on the backends I have: service doveadm { inet_listener { port = 24245

[Dovecot] pop3 not autocreating directory structure

2012-02-14 Thread Jan-Frode Myklebust
We use: mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln mail: mdbox:~/mdbox and I just noticed one of our newly provisioned users initially failed to pop her mails. I saw several of these: dovecot:: pop3(new.u...@example.net): Error: Couldn't open INBOX: Mailbox doesn't exi

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 01:24:25PM -0700, Michael M Slusarz wrote: > > Except you are most likely NOT leveraging the truly interesting part > of imapproxy - the ability to restore the IMAP connection state via > the XPROXYREUSE status response. This is a significant performance > improvement sinc

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 09:57:31PM +0200, Timo Sirainen wrote: > > > > $ doveconf maildir_very_dirty_syncs > > maildir_very_dirty_syncs = yes > > > > but I don't think this gave the advantage I was expecting.. Was > > expecting this to move most iops to the index-luns, but the maildir > >

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 11:08:48AM -0800, Mark Moseley wrote: > > Out of curiosity, are you running dovecot locally on those webmail > servers as well, or is it talking to remote dovecot servers? The webmail servers are talking with dovecot director servers which in turn are talking with the back

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 04:14:22PM +0200, Timo Sirainen wrote: > > The responstimes are not very fast, but they do seem to support > > the claim that an imapproxy isn't needed for dovecot. > > That's what I always suspected, but good to have someone actually test it. :) > This is with Maildir? Y

[Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
We've been collecting some stats to see what kind of benefits UP/SquirrelMail's IMAP Proxy in for our SOGo webmail users. Dovecot is running in High-performance mode http://wiki2.dovecot.org/LoginProcess with authentication caching http://wiki2.dovecot.org/Authentication/Caching During the weekend

Re: [Dovecot] Issues with SIS and Backups - was Re: v2.1.0 status

2012-02-12 Thread Jan-Frode Myklebust
On Sun, Feb 12, 2012 at 05:58:20PM +0200, Timo Sirainen wrote: > > doveadm backup -u user@domain backup: > > And it would output the user's messages to stdout (or to some file). So it > would be similar to e.g. PostgreSQL's pg_dump. So only full backups, no incremental backups? Then what's the

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-09 Thread Jan-Frode Myklebust
On Thu, Feb 09, 2012 at 01:48:09AM +0200, Timo Sirainen wrote: > On 7.2.2012, at 10.25, Jan-Frode Myklebust wrote: > > > Feb 6 16:13:10 loadbalancer2 dovecot: lmtp(6601): Panic: file > > lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: > >

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-07 Thread Jan-Frode Myklebust
On Mon, Feb 06, 2012 at 10:01:03PM +0100, Jan-Frode Myklebust wrote: > > Your fsyncs can run over 60 seconds? > > Hopefully not.. maybe just me being confused by the error message about > "lmtp_proxy_output_timeout". After adding > http://hg.dovecot.org/dovecot-2.0/re

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-06 Thread Jan-Frode Myklebust
On Mon, Feb 06, 2012 at 10:29:03PM +0200, Timo Sirainen wrote: > On 3.2.2012, at 14.25, Jan-Frode Myklebust wrote: > > > I now implemented this patch on our directors, and pointed postfix at them. > > No problem seen so far, but I'm still a

[Dovecot] doveadm purge on shared storage

2012-02-06 Thread Jan-Frode Myklebust
We've finally (!) started to put some users on mdbox instead of maildir, and now I'm wondering about the purge step. As we're running GPFS for the mailboxes (and dovecot director in front of every dovecot service), is it important to run the "doveadm purge -u $user" on the same host as $user is lo

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-03 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 02:41:11PM +0200, Timo Sirainen wrote: > > >> That is most likely related to your troubles. If the dsync runs crash, > >> the result could leave extra files lying around etc.. > > > > If dsync backup is supposed to be a viable backup solution, I think it > > should fail mu

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-03 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 09:03:18PM +0200, Timo Sirainen wrote: > > > > I think the way I originally planned LMTP proxying to work is simply too > > complex to work reliably, perhaps even if the code was bug-free. So > > instead of reading+writing DATA at the same time, this patch chang

Re: [Dovecot] Question about quota configuration

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 11:58:12PM +0100, przemek.orzechow...@makolab.pl wrote: > > What im tryin to do now is to modify postfix->procmail->dovecot config > in a way that if user is over quota mail delivery is delayed instead of > bouncing. > (is this possible?) Check the quota_full_tempfail se

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 12:31:20PM +0100, Jan-Frode Myklebust wrote: > > and numlinks=4: > > # ls -al > /srv/mailbackup/attachments/c3/1b/c31beb42ef78810f7fb81a7086144034fb0fd794*|wc > -l > 3 > > is dovecot somehow creating numlinks+1 copies of every

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 12:23:01PM +0200, Timo Sirainen wrote: > > Note that with SIS the attachments aren't compressed. Yes, I know. > > > "/srv/mailbackup/attachments/c3/17/c317b32b97688c16859956f11b803e3bba434349-057274283bb51f4f917ebf34f6ab" > > is > > missing, but there are 205 other

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 08:46:55AM +0100, Alessio Cecchi wrote: > > How many users there are in this installation? Quite a few :-) This is for an ISP. > >The active servers are using Maildir, and has: > > > > $ df -h /usr/local/atmail/users/ > > FilesystemSize Used Avail Use

[Dovecot] Doubts about dsync, mdbox, SIS

2012-02-01 Thread Jan-Frode Myklebust
I've been running continous dsync backups of our Maildirs for a few weeks now, with the destination dsync server using mdbox and SIS. The idea was that the destination server would act as a warm copy of all our active users data. The active servers are using Maildir, and has: $ df -h /us

Re: [Dovecot] make imap search less verbose

2012-01-23 Thread Jan-Frode Myklebust
On Mon, Jan 23, 2012 at 11:56:49PM +0200, Timo Sirainen wrote: > > No way to disable it without modifying code. I think SOGo should fix it > anyway.. > Ok, thanks. SOGo will get fixed. I was just looking for a quick workaround while we wait for updated sogo. -jf

[Dovecot] make imap search less verbose

2012-01-23 Thread Jan-Frode Myklebust
We have an imap-client (SOGo) that doesn't handle this status output while searching: * OK Searched 76% of the mailbox, ETA 0:50 Is there any way to disable this output on the dovecot-side? -jf

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-01-18 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 09:03:18PM +0200, Timo Sirainen wrote: > On 18.1.2012, at 20.51, Jan-Frode Myklebust wrote: > > >> What's the problem with director-based architecture? > > > > It hasn't been working reliably for lmtp in v2.0. > > Ye

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-01-18 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 07:58:31PM +0200, Timo Sirainen wrote: > > > --i.e. all the > > suggestions at http://wiki2.dovecot.org/NFS. Is that definitely not > > the case? Is there anything else (beyond moving to a director-based > > architecture) that can mitigate the risk of index corruption? In o

[Dovecot] resolve mail_home ?

2012-01-17 Thread Jan-Frode Myklebust
I now have "mail_home = /srv/mailstore/%256RHu/%d/%n". Is there any way of asking dovecot where a user's home directory is? It's not in "doveadm user": $ doveadm user -f home janfr...@lyse.net $ doveadm user janfr...@tanso.net userdb: janfr...@tanso.net mail

[Dovecot] dsync conversion and ldap attributes

2012-01-13 Thread Jan-Frode Myklebust
I have: mail_home = /srv/mailstore/%256RHu/%d/%n mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } and the dovecot-ldap.conf.ext specifies: user_attrs

Re: [Dovecot] GPFS for mail-storage (Was: Re: Compressing existing maildirs)

2012-01-03 Thread Jan-Frode Myklebust
On Wed, Jan 04, 2012 at 12:09:39AM -0600, l...@airstreamcomm.net wrote: > Could you remark on GPFS services hosting mail storage over a WAN between > two geographically separated data centers? I haven't tried that, but know the theory quite well. There are 2 or 3 options: 1 - shared SA

Re: [Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-03 Thread Jan-Frode Myklebust
On Tue, Jan 03, 2012 at 02:34:59PM +0200, Timo Sirainen wrote: > On Tue, 2012-01-03 at 13:12 +0100, Jan-Frode Myklebust wrote: > > dsync-remote(janfr...@tanso.net): Error: Can't delete mailbox directory > > INBOX.a: Mailbox has children, delete them first > > Oh, th

Re: [Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-03 Thread Jan-Frode Myklebust
On Tue, Jan 03, 2012 at 02:00:08PM +0200, Timo Sirainen wrote: > > So here on source you have namespace separator '.' and in destination > you have separator '/'? Maybe that's the problem? Try with both having > '.' separator. I added this namespace on the destination: namespace { inbox = yes

[Dovecot] GPFS for mail-storage (Was: Re: Compressing existing maildirs)

2012-01-03 Thread Jan-Frode Myklebust
On Sat, Dec 31, 2011 at 01:54:32AM -0600, Stan Hoeppner wrote: > Nice setup. I've mentioned GPFS for cluster use on this list before, > but I think you're the only operator to confirm using it. I'm sure > others would be interested in hearing of your first hand experience: > pros, cons, performan

  1   2   3   >