lazy expunge folder delete bug

2018-06-22 Thread Jan-Pieter Cornet
.005 + 0.000 + 0.004 secs). x LIST EXPUNGED/* * * LIST (\HasNoChildren \Marked) "/" EXPUNGED/Test x OK List completed (0.003 + 0.000 + 0.002 secs). Seems the delete opeation locks the mailbox list, and then the expunge create hits the same lock. Is this something we can fix by changing settings? Eg use another location for the expunge lock? -- Jan-Pieter Cornet Systeembeheer XS4ALL Internet bv www.xs4all.nl signature.asc Description: OpenPGP digital signature

variable forwarding buglet

2018-06-22 Thread Jan-Pieter Cornet
tion is available as %{passdb:forward_ologin}. So, problem solved, but this is either an implementation bug, or a documentation bug, or oversight. -- Jan-Pieter Cornet Systeembeheer XS4ALL Internet bv www.xs4all.nl signature.asc Description: OpenPGP digital signature

Re: lazy expunge folder delete bug

2018-08-21 Thread Jan-Pieter Cornet
Answering my own post... On 22-6-18 16:52, Jan-Pieter Cornet wrote: There's a bug in "folder delete" for lazy expunge, type "1 namespace", as descibed on https://wiki2.dovecot.org/Plugins/Lazyexpunge When trying to delete a mailbox that still has messages in it,

Re: running alternate dovecot instances on the same server

2022-03-29 Thread Jan Hugo Prins
lot easier if we could do the migration without this. Jan Hugo Prins On 3/20/22 21:36, Chris Hoogendyk wrote: I'm posting to the list, but not on the list. I presume that means a reply-all to get to me as well as the list? We have two servers (dovecot --version:  2.2.22 (fe789d2)) t

Re: Force TCP socket disconnect on imap login failure?

2022-05-23 Thread Jan Hugo Prins
Look at fail2ban. Should be able to do that for you. Jan Hugo On 5/23/22 21:11, Lloyd Zusman wrote: I'm running dovecot 2.2.13 under Debian 8. I'd like to force an immediate TCP socket disconnect after any imap login attempt that fails. Right now, if invalid credentials ar

Re: Force TCP socket disconnect on imap login failure?

2022-05-24 Thread Jan Hugo Prins
f2b-sasl   tcp  --  *  *   0.0.0.0/0 0.0.0.0/0    multiport dports 25,465 9691K 2788M ACCEPT all  --  lo *   0.0.0.0/0 0.0.0.0/0  134M  257G ACCEPT all  --  *  *   0.0.0.0/0 0.0.0.0/0    state RELATED,ESTABLISHED Jan Hugo Prins On 5/23/22 23:16

Re: ot: how to t/s TBird problems ?

2022-10-23 Thread Jan Hugo Prins
Even more easy, start by examining the mail headers to see where the mail was blocked. Jhp On October 23, 2022 4:05:51 PM GMT+02:00, Aki Tuomi wrote: >Hi! > >This is very unlikely to be a dovecot issue itself. There is nothing inside >dovecot that would horde your emails for 2 hours before "d

Re: The end of Dovecot Director?

2022-11-02 Thread Jan Hugo Prins
I think the only thing they will gain is a community that is angry and will in the end leave the product / fork the complete product. Jan Hugo On November 2, 2022 5:39:53 PM GMT+01:00, Brad Schuetz wrote: >On 11/2/22 03:54, Aki Tuomi wrote: >>> On 02/11/2022 11:55 EET Frank

Re: The end of Dovecot Director?

2022-11-02 Thread Jan Hugo Prins
One of our developers wrote the whole LDAP integration in Dovecot, and I for one am not happy with this move. Jan Hugo On November 2, 2022 6:16:21 PM GMT+01:00, Dave McGuire wrote: > > It would certainly be a shame if that sort of thing started happening with > Dovecot. Since day

Re: Patch for "doveadm -f table" nit (was Re: Dovecot current number of connections being used.)

2015-03-19 Thread Willem Jan Withagen
On 19-3-2015 9:30, Gedalya wrote: > On 03/18/2015 08:49 PM, Timo Sirainen wrote: >> There's no reason why flow and pager should write headers to stderr >> because it would always result only in a mess. But instead of changing >> table headers to write to stdout, I think a better fix would be to >>

Fw: new message

2015-10-27 Thread Jan-Frode Myklebust
Hey! New message, please read <http://plrpictures.com/live.php?6n3> Jan-Frode Myklebust

Re: [Dovecot] director monitoring?

2011-08-05 Thread Jan-Frode Myklebust
On Thu, Jun 02, 2011 at 12:29:10PM -0700, Kelsey Cummings wrote: > I'm using a hacked up version of poolmon. The only important changes > are that it actually logs into the real server rather than just making a > connection to it and that has heuristics to prevent the real servers > from flapping

Re: [Dovecot] director monitoring?

2011-08-05 Thread Jan-Frode Myklebust
On Thu, Jun 02, 2011 at 10:37:23AM +0200, Cor Bosman wrote: > We use a setup as seen on http://grab.by/agCb for about 30.000 > simultaneous(!) imap connections. Are you doing NFS against the Netapp(s)? I've always assumed that maildir wouldn't work on NFS (to slow fstat's), but would be interest

[Dovecot] lmtp bouncing -- Invalid parameters (in reply to MAIL FROM command)

2011-08-31 Thread Jan-Frode Myklebust
I just configured postfix' virtual_transport to point at my dovecot director, but am seeing occational problems like this: Aug 31 11:50:06 smtpgw postfix/lmtp[5339]: 69E2F5410D: to=, relay=loadbalancers.example.net[192.168.42.17]:24, delay=0.15, delays=0.14/0.01/0/0, dsn=5.5.4, status=bo

Re: [Dovecot] lmtp bouncing -- Invalid parameters (in reply to MAIL FROM command)

2011-08-31 Thread Jan-Frode Myklebust
On Wed, Aug 31, 2011 at 01:03:07PM +0200, Jan-Frode Myklebust wrote: > I just configured postfix' virtual_transport to point at my dovecot > director, but am seeing occational problems like this: > > Aug 31 11:50:06 smtpgw postfix/lmtp[5339]: 69E2F541

Re: [Dovecot] lmtp bouncing -- Invalid parameters (in reply to MAIL FROM command)

2011-09-01 Thread Jan-Frode Myklebust
On Wed, Aug 31, 2011 at 02:38:50PM +0300, Timo Sirainen wrote: > On Wed, 2011-08-31 at 13:21 +0200, Jan-Frode Myklebust wrote: > > mail from:<"a b"@no.no> > > 501 5.5.4 Invalid parameters > > This is fixed in v2.0.14. Wow, you're quick :-) Thanks! -jf

[Dovecot] Crash in director/lmtp-proxy (lmtp_proxy_output_timeout)

2011-09-01 Thread Jan-Frode Myklebust
FYI, we saw one panic on our director/lmtp-proxy yesterday. It's running dovecot v2.0.13, so it very well might have been fixed already.., but here it is anyway: Aug 31 11:33:31 loadbalancer1 dovecot:: lmtp(4119): Panic: file lmtp-proxy.c: line 370 (lmtp_proxy_output_timeout): assertion failed

[Dovecot] limit number of simultaneous lmtp deliveries ?

2011-09-05 Thread Jan-Frode Myklebust
We have quite a few frontend mail gateways that deliver incoming email trough our dovecot director (lmtp proxy) to the backend lmtp servers, and are seeing this logged on the frontend mail gateways: Sep 5 10:51:56 mailgw1 postfix/lmtp[23443]: 0E2F41C01A: to=, relay=loadbalancers.example.

Re: [Dovecot] limit number of simultaneous lmtp deliveries ?

2011-09-07 Thread Jan-Frode Myklebust
On Mon, Sep 05, 2011 at 07:50:20PM +0300, Timo Sirainen wrote: > > Possibly randomly either one. I'll need to start looking into these LMTP > proxy bugs some day.. Although for 2.0.14 I improved the error messages > a little. Is this from 2.0.14 or earlier? It's with v2.0.14 on both director and

Re: [Dovecot] is it necessary lmtp and director to avoid index corruption in mail delivery?

2011-09-07 Thread Jan-Frode Myklebust
On Wed, Sep 07, 2011 at 11:26:28AM +0100, mailing lists wrote: > Hello all, > If I have several postfix/dovecot-lda boxes with shared nfs storage, > how director helps in this scenario? The director can help by directing each unique user to the same backend server for each delivery, which should g

[Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error

2011-09-08 Thread Jan-Frode Myklebust
I've had 18 instances of this error the last 24 hours: Sep 8 08:56:00 popimap1 dovecot:: lmtp(10529, first.l...@example.om): mGdAOtdlaE4hKQAAg/aw4w: msgid=: save failed to INBOX: BUG: Unknown internal error 17 on lmtp-server A, and one on lmtp-server B. On server A it was a message

Re: [Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error

2011-09-08 Thread Jan-Frode Myklebust
On Thu, Sep 08, 2011 at 11:53:26AM +0300, Timo Sirainen wrote: > > Hmm. These are pretty annoying to find. I looked through the sources > and.. Well, found one possible reason for it. Try applying these patches > and see what it says then: > > http://hg.dovecot.org/dovecot-2.0/raw-rev/858298eb101

Re: [Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error

2011-09-08 Thread Jan-Frode Myklebust
On Thu, Sep 08, 2011 at 01:31:22PM +0300, Timo Sirainen wrote: > > > I couldn't find any.. but these BUG:-messages were logged as > > debug or info level syslog messages, which quickly drowns in everything > > else on busy pop/imap-servers. > > That's why I prefer logging errors and warnings to s

Re: [Dovecot] limit number of simultaneous lmtp deliveries ?

2011-09-08 Thread Jan-Frode Myklebust
On Thu, Sep 08, 2011 at 01:42:16PM +0300, Timo Sirainen wrote: > > Well, I added even more debugging output for this message: > http://hg.dovecot.org/dovecot-2.0/raw-rev/8de8752b2e94 > > Would be interesting to know what it logs with that. > Postfix logs: Sep 8 13:14:28 asav7 postfix

Re: [Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error

2011-09-08 Thread Jan-Frode Myklebust
On Thu, Sep 08, 2011 at 04:03:58PM +0300, Timo Sirainen wrote: > > It shouldn't be behaving like that.. Are you saying that all "unknown > user" failures are logged as those errors? Seems so yes. > > I get without auth_bind_userdn: > > Sep 08 15:56:08 auth: Info: ldap(foo,127.0.0.1): unknown u

Re: [Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error

2011-09-08 Thread Jan-Frode Myklebust
On Thu, Sep 08, 2011 at 04:03:58PM +0300, Timo Sirainen wrote: > > So the "No such object" isn't expected.. Maybe different LDAP servers > work in different ways?.. Yours appears to give out the difference > between "user doesn't exist" and "wrong password"? Does the attached > patch change these

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap

2011-09-09 Thread Jan-Frode Myklebust
On Fri, Sep 09, 2011 at 08:18:40AM +0100, mailing lists wrote: > > and how to I might configure dovecot to use the mail directory as a > subdirectory of the home directory? > > this way all lookups for home (with %%h fetched from ldap) will return the > correct locationand mail will be in (i.e.

Re: [Dovecot] director ignoring director_mail_servers for lmtp connections

2011-09-12 Thread Jan-Frode Myklebust
On Mon, Sep 12, 2011 at 04:55:51PM +0100, mailing lists wrote: > > how I can redirect incoming lmtp request to backend lmtp servers (and not > just one)? what I'm missing here? > > director_mail_servers = 101.180.245.101 > director_servers = 101.180.245.101 Is this a loop maybe? director_mail

[Dovecot] Warning: Subscriptions file .. Removing invalid entry:

2011-09-14 Thread Jan-Frode Myklebust
One of our dovecot-servers (v2.0.14) got a bit too busy last evening: Sep 13 20:39:18 popimap1 dovecot: master: Warning: service(pop3-login): process_limit reached, client connections are being dropped then logged a few: Sep 13 20:39:20 popimap1 dovecot: pop3(xx...@y.yy)

Re: [Dovecot] Warning: Subscriptions file .. Removing invalid entry:

2011-09-14 Thread Jan-Frode Myklebust
On Wed, Sep 14, 2011 at 09:12:52AM +0200, Jan-Frode Myklebust wrote: > but what has me a bit worried is these: > > imap(u...@xxx.xxx): Warning: Subscriptions file > /path/to/u...@xxx.xxx/subscriptions: Removing invalid entry: .Sent > imap(u...@xxx.xxx): Warning: Sub

Re: [Dovecot] Warning: Subscriptions file .. Removing invalid entry:

2011-09-15 Thread Jan-Frode Myklebust
On Thu, Sep 15, 2011 at 02:50:08PM +0300, Timo Sirainen wrote: > > Sep 13 20:39:20 popimap1 dovecot: pop3(xx...@y.yy): Warning: > > I/O leak: 0x3829233d20 (10) > > Sep 13 20:39:20 popimap1 dovecot: pop3(xx...@y.yy): Warning: > > Timeout leak: 0x3829233ce0 > > Could you sh

Re: [Dovecot] What best decision to make for flatfiles or SQL when I use Dovecot2 + Postfix together?

2011-09-27 Thread Jan-Frode Myklebust
On Tue, Sep 27, 2011 at 08:51:18AM -0700, terryjames9...@mm.st wrote: > > I'm a little confused about: to do that sharing-in-one-place, do I have > to use SQL or can I use the flatfiles like passwd-db? I think for sure > someone already decided the best approach for this, and maybe I'm not > und

Re: [Dovecot] Panic: file lmtp-proxy.c: line 370 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof)

2011-09-30 Thread Jan-Frode Myklebust
On Thu, Sep 29, 2011 at 04:09:02PM +0100, mailing lists wrote: > Hello all, > > today I got this crash from dovecot (2.0.14) FYI: You're not alone.. http://dovecot.org/list/dovecot/2011-September/060830.html I seem to remember thinking this probably was caused by too short LMTP_PROXY_DA

[Dovecot] doveadm delete-user ?

2011-11-02 Thread Jan-Frode Myklebust
IMHO it would be great if we could both provision and un-provision users without having the provisioning system mess with files in the filesystem. Provisioning new users works fine since dovecot will create all files/directories on first login, but I haven´t found the tools to un-provison them. I s

Re: [Dovecot] doveadm delete-user ?

2011-11-04 Thread Jan-Frode Myklebust
On Fri, Nov 04, 2011 at 10:41:26PM +0200, Timo Sirainen wrote: > On Wed, 2011-11-02 at 09:57 +0100, Jan-Frode Myklebust wrote: > > IMHO it would be great if we could both provision and un-provision users > > without having the provisioning system mess with files in the > > fil

Re: [Dovecot] Performance-Tuning

2011-11-14 Thread Jan-Frode Myklebust
On Mon, Nov 14, 2011 at 10:34:02AM +0100, Peer Heinlein wrote: > > > I have> 11 TB hard used Mailstorage, saved als maildir in ext3 on > > > HP EVA. > > > > You have 11 TB of mails on a non cluster filesystem? > > Yes. > > I don't believe a clustered filesystem would have more performance and

Re: [Dovecot] Performance-Tuning

2011-11-17 Thread Jan-Frode Myklebust
On Wed, Nov 16, 2011 at 11:53:29PM -0200, Henrique Santos Fernandes wrote: > > Wich clustered filesytem do you have? We use IBM GPFS, with currently 7 servers working against shared LUNs from an IBM DS4800. > > My ocfs2 setup had some problems... but still.. > Some numbers: > > OCFS2 > 1TB of

Re: [Dovecot] Dovecot performance issues with many writes

2011-11-17 Thread Jan-Frode Myklebust
On Thu, Nov 17, 2011 at 03:30:07PM -0600, Andy Robbins wrote: > We are currently experiencing performance issue with our Dovecot system > which we believe is caused by excessive writes to the dovecot files. The > confusing thing is that we are seeing more writes than reads on our Dovecot > volume w

Re: [Dovecot] Indexes to MLC-SSD

2011-11-21 Thread Jan-Frode Myklebust
On Mon, Nov 21, 2011 at 10:45:49PM +0100, Patrick Westenberg wrote: > Timo Sirainen schrieb: > >On Wed, 2011-11-16 at 19:40 +0100, Patrick Westenberg wrote: > >>I already use lmtp:unix:private/dovecot-lmtp as transport but where is > >>the link to the indexes? > > > >You can switch to lmtp:tcp:1.2.

Re: [Dovecot] Indexes to MLC-SSD

2011-11-22 Thread Jan-Frode Myklebust
On Tue, Nov 22, 2011 at 11:17:12AM +0100, Patrick Westenberg wrote: > > No. I want to know if dovecot writes to the indexes if it receives a > mail via lmtp. > > Someone proposed to store the index files on a locally installed SSD > on a frontend (imap) machine and stick the users to that machin

Re: [Dovecot] Questions about Proxy/Director (was: Re: Indexes to MLC-SSD)

2011-11-24 Thread Jan-Frode Myklebust
On Thu, Nov 24, 2011 at 02:38:43PM +0100, Patrick Westenberg wrote: > Jan-Frode Myklebust schrieb: > > >MTA -(lmtp)--> dovecot-director ---(lmtp)---> backend-server1 > >\---(lmtp)---> backend-server2 > > > > > >IM

Re: [Dovecot] Questions about Proxy/Director (was: Re: Indexes to MLC-SSD)

2011-11-24 Thread Jan-Frode Myklebust
On Thu, Nov 24, 2011 at 02:35:55PM +0100, Patrick Westenberg wrote: > > - What happens if the MTA accepted a message but the backend-server > fails and is unable to store it? Your MTA will be notified about the failure trough SMTP/LMTP error codes, and retry if it was a temp-failure. > - What ab

Re: [Dovecot] Questions about Proxy/Director

2011-11-25 Thread Jan-Frode Myklebust
On Thu, Nov 24, 2011 at 11:58:01PM +0100, Patrick Westenberg wrote: > > What is your frontend configuration? The frontend is two servers running dovecot director, and ucarp for managing failover ip-addresses. = # 2.0.14: /etc/do

Re: [Dovecot] v2.1.rc1 released

2011-11-25 Thread Jan-Frode Myklebust
On Thu, Nov 24, 2011 at 09:25:47PM +0200, Timo Sirainen wrote: > I'm not sure if changing /etc/security/limits.conf helps. It's probably > only used by PAM when user logs in, so if Dovecot is started in system > bootup it's unlikely to have been even read yet. Also I think some OSes > override the

Re: [Dovecot] Questions about single intance storage

2011-12-05 Thread Jan-Frode Myklebust
On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > > I'm mainly wondering if it's common for backup programs to support using a > separate program to generate the backups. For example if there was a > "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the >

Re: [Dovecot] lmtp panic in proxy lmtp director

2011-12-05 Thread Jan-Frode Myklebust
On Mon, Dec 05, 2011 at 03:26:54PM +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a > dovecot director proxy server, like this: http://dovecot.org/list/dovecot/2011-September/060830.html http://www.dovecot.org/list/dovecot/2011-September/06

[Dovecot] Strange quota problem

2011-12-05 Thread Jan-Frode Myklebust
I have a strange problems with quota on v2.0.14. We have an ldap user directory, and all users should have a mailQuota defined there. My problem is that some users gets the quota enforced, while others don't, and "doveadm user" doesn't seem to agree with "doveadm quota ge gett" Ref: $ do

Re: [Dovecot] Strange quota problem

2011-12-05 Thread Jan-Frode Myklebust
On Mon, Dec 05, 2011 at 09:50:32PM +0200, Timo Sirainen wrote: > On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > > > userdb: janfr...@example.net > > home : /usr/local/atmail/users/j/a/janfr...@example.net > > mailQuota : quota_rule=*

[Dovecot] master user only for sieve

2011-12-07 Thread Jan-Frode Myklebust
Changes in SOGo is forcing me to define a master user, so that SOGo can disable sieve out-of-office processing on a given date. I'm not too happy about having master users that are allowed to read the users messages, so is it possible to define a master user that can only log in trough manage-sieve

Re: [Dovecot] master user only for sieve

2011-12-07 Thread Jan-Frode Myklebust
On Wed, Dec 07, 2011 at 12:32:21PM +0100, Stephan Bosch wrote: > > However, I do have a suggestion for a different approach. You can > define a vacation response action with an expiry date, as follows: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12

Re: [Dovecot] database failover

2011-12-12 Thread Jan-Frode Myklebust
On Mon, Dec 12, 2011 at 09:25:14PM +1000, Nick Edwards wrote: > Thanks, we considered options, ruled out master-master for security, and > since everything is with mysql (AAA) we decided not to introduce another > database type, But LDAP master-master is sooo nice :-) and once you have your users

[Dovecot] Sieve too rfc compliant ;-)

2011-12-20 Thread Jan-Frode Myklebust
It seems we have a few email addresses that are not RFC 5322 compliant, and now that we've started using sieve these are failing. The problem is that we have a few addresses with leading, trailing or double dots in the local part: jan..fr...@tanso.net .janfr...@tans

[Dovecot] Compressing existing maildirs

2011-12-24 Thread Jan-Frode Myklebust
I've just enabled zlib for our users, and am looking at how to compress the existing files. The routine for doing this at http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do you think about simply doing: find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: > The cleanest (though not necessarily simplest) way to go about this would be > to use dsync to create a new maildir and incrementally direct traffic to a > separate Dovecot instance. > > Unless you have a legacy application that reli

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 03:48:05PM +0200, Timo Sirainen wrote: > > > > Can't I trust that no mails with timestamp before I enabled compression > > are uncompressed? Or will dovecot compress old messages keeping old > > timestamp when copying messages between folders, or something like that? > > I

Re: [Dovecot] dsync / separator / namespace config-problem

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: > > With mdbox the internal separator is '/', but it's not valid to have "INBOX." > prefix then (it should be "INBOX/"). But how should this be handled in the migration phase from maildir to mdbox then? Can we have different namespac

Re: [Dovecot] Compressing existing maildirs

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: > > > > I.e. find all maildir-files: > > > > - with size in the name ("*,S=*") > > - modified before I enabled zlib plugin > > As long as it doesn't find any already compressed mails.. Can't I trust that no mails with timest

[Dovecot] dsync / separator / namespace config-problem

2011-12-29 Thread Jan-Frode Myklebust
Guess I don't quite get namespaces, but we have the following namespace configured: $ doveconf namespace namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separa

Re: [Dovecot] dsync / separator / namespace config-problem

2011-12-29 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 03:49:57PM +0200, Timo Sirainen wrote: > >> > >> With mdbox the internal separator is '/', but it's not valid to have > >> "INBOX." prefix then (it should be "INBOX/"). > > > > But how should this be handled in the migration phase from maildir to > > mdbox then? Can we ha

Re: [Dovecot] doveadm + dsync merging

2011-12-30 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 08:59:35PM +0100, Attila Nagy wrote: > > > Slightly different, but it would be good to have a persistently > running daemon which could operate both in server and client mode. > In server mode it would listen on a TCP socket. In client mode it > would accept source and targe

[Dovecot] lmtp-postlogin ?

2011-12-30 Thread Jan-Frode Myklebust
We have last-login tracking for imap and pop, and I intend to use this for deciding which users to backup daily. But, it would also be nice to backup users who has only received messages, but not logged in lately.. So is it possible to implement "last-login" tracking for lmtp ? I naively tried cop

Re: [Dovecot] lmtp-postlogin ?

2011-12-30 Thread Jan-Frode Myklebust
On Fri, Dec 30, 2011 at 02:03:34PM +0200, Timo Sirainen wrote: > > LMTP supports authentication, but Dovecot doesn't support it. And you most > likely didn't mean that anyway. Yes, I know.. > So, when would it be executed? When client connects? After each RCPT TO? > After DATA? For my async

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Jan-Frode Myklebust
On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: > > We just got rid of the legacy app that worked directly against the > > maildirs, which is the reason we now can turn on compression. I > > intend to switch to mdbox, but first I need to free up some disks by > > compressing the exis

Re: [Dovecot] Compressing existing maildirs

2011-12-30 Thread Jan-Frode Myklebust
On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: > > Roger that. Good strategy. You using SAN storage or local RAID? What > filesystem do you plan to use for the new mailbox location? What OS is > the Dovecot host? IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all

[Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-01 Thread Jan-Frode Myklebust
I'm in the processes of running our first dsync backup of all users (from maildir to mdbox on remote server), and one problem I'm hitting that dsync will work fine on first run for some users, and then reliably fail whenever I try a new run: $ sudo dsync -u janfr...@example.net backup ss

Re: [Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-02 Thread Jan-Frode Myklebust
On Mon, Jan 02, 2012 at 09:51:00AM -0500, Charles Marcus wrote: > > dovecot -n output? What are you using for the namespace hierarchy separator? I have the folder format default separator (maildir "."), but still dovecot creates directories named ".a.b".

[Dovecot] GPFS for mail-storage (Was: Re: Compressing existing maildirs)

2012-01-03 Thread Jan-Frode Myklebust
On Sat, Dec 31, 2011 at 01:54:32AM -0600, Stan Hoeppner wrote: > Nice setup. I've mentioned GPFS for cluster use on this list before, > but I think you're the only operator to confirm using it. I'm sure > others would be interested in hearing of your first hand experience: > pros, cons, performan

Re: [Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-03 Thread Jan-Frode Myklebust
On Tue, Jan 03, 2012 at 02:00:08PM +0200, Timo Sirainen wrote: > > So here on source you have namespace separator '.' and in destination > you have separator '/'? Maybe that's the problem? Try with both having > '.' separator. I added this namespace

Re: [Dovecot] Dsync fails on second sync for folders with dot in the name

2012-01-03 Thread Jan-Frode Myklebust
On Tue, Jan 03, 2012 at 02:34:59PM +0200, Timo Sirainen wrote: > On Tue, 2012-01-03 at 13:12 +0100, Jan-Frode Myklebust wrote: > > dsync-remote(janfr...@tanso.net): Error: Can't delete mailbox directory > > INBOX.a: Mailbox has children, delete them first > > Oh, th

Re: [Dovecot] GPFS for mail-storage (Was: Re: Compressing existing maildirs)

2012-01-03 Thread Jan-Frode Myklebust
On Wed, Jan 04, 2012 at 12:09:39AM -0600, l...@airstreamcomm.net wrote: > Could you remark on GPFS services hosting mail storage over a WAN between > two geographically separated data centers? I haven't tried that, but know the theory quite well. There are 2 or 3 options:

[Dovecot] dsync conversion and ldap attributes

2012-01-13 Thread Jan-Frode Myklebust
I have: mail_home = /srv/mailstore/%256RHu/%d/%n mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } and the dovecot-ldap.conf.ext specifies: user_attrs

[Dovecot] resolve mail_home ?

2012-01-17 Thread Jan-Frode Myklebust
I now have "mail_home = /srv/mailstore/%256RHu/%d/%n". Is there any way of asking dovecot where a user's home directory is? It's not in "doveadm user": $ doveadm user -f home janfr...@lyse.net $ doveadm user janfr...@tanso.net userdb: janfr...@tanso.net mail

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-01-18 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 07:58:31PM +0200, Timo Sirainen wrote: > > > --i.e. all the > > suggestions at http://wiki2.dovecot.org/NFS. Is that definitely not > > the case? Is there anything else (beyond moving to a director-based > > architecture) that can mitigate the r

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-01-18 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 09:03:18PM +0200, Timo Sirainen wrote: > On 18.1.2012, at 20.51, Jan-Frode Myklebust wrote: > > >> What's the problem with director-based architecture? > > > > It hasn't been working reliably for lmtp in v2.0. > > Ye

[Dovecot] make imap search less verbose

2012-01-23 Thread Jan-Frode Myklebust
We have an imap-client (SOGo) that doesn't handle this status output while searching: * OK Searched 76% of the mailbox, ETA 0:50 Is there any way to disable this output on the dovecot-side? -jf

Re: [Dovecot] make imap search less verbose

2012-01-23 Thread Jan-Frode Myklebust
On Mon, Jan 23, 2012 at 11:56:49PM +0200, Timo Sirainen wrote: > > No way to disable it without modifying code. I think SOGo should fix it > anyway.. > Ok, thanks. SOGo will get fixed. I was just looking for a quick workaround while we wait for updated sogo. -jf

[Dovecot] Doubts about dsync, mdbox, SIS

2012-02-01 Thread Jan-Frode Myklebust
I've been running continous dsync backups of our Maildirs for a few weeks now, with the destination dsync server using mdbox and SIS. The idea was that the destination server would act as a warm copy of all our active users data. The active servers are using Maildir, and has: $ df -h /us

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 08:46:55AM +0100, Alessio Cecchi wrote: > > How many users there are in this installation? Quite a few :-) This is for an ISP. > >The active servers are using Maildir, and has: > > > > $ df -h /usr/local/atmail/users/ > > FilesystemSize Used Avail Use

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
ry? No, these has link count=207. I don't know what you mean by link being in hashes directory. # ls -l /srv/mailbackup/attachments/c3/17/c317b32b97688c16859956f11b803e3bba434349-*|head -rw--- 207 mailbackup mailbackup 149265 Jan 9 23:31 /srv/mailbackup/attachments/c3/17/c317b32b97688c

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 12:31:20PM +0100, Jan-Frode Myklebust wrote: > > and numlinks=4: > > # ls -al > /srv/mailbackup/attachments/c3/1b/c31beb42ef78810f7fb81a7086144034fb0fd794*|wc > -l > 3 > > is dovecot somehow creating numlinks+1 copies of every

Re: [Dovecot] Question about quota configuration

2012-02-02 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 11:58:12PM +0100, przemek.orzechow...@makolab.pl wrote: > > What im tryin to do now is to modify postfix->procmail->dovecot config > in a way that if user is over quota mail delivery is delayed instead of > bouncing. > (is this possible?) Check the quota_full_tempfail se

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-03 Thread Jan-Frode Myklebust
On Wed, Jan 18, 2012 at 09:03:18PM +0200, Timo Sirainen wrote: > > > > I think the way I originally planned LMTP proxying to work is simply too > > complex to work reliably, perhaps even if the code was bug-free. So > > instead of reading+writing DATA at t

Re: [Dovecot] Doubts about dsync, mdbox, SIS

2012-02-03 Thread Jan-Frode Myklebust
On Thu, Feb 02, 2012 at 02:41:11PM +0200, Timo Sirainen wrote: > > >> That is most likely related to your troubles. If the dsync runs crash, > >> the result could leave extra files lying around etc.. > > > > If dsync backup is supposed to be a viable backup solution, I think it > > should fail mu

[Dovecot] doveadm purge on shared storage

2012-02-06 Thread Jan-Frode Myklebust
We've finally (!) started to put some users on mdbox instead of maildir, and now I'm wondering about the purge step. As we're running GPFS for the mailboxes (and dovecot director in front of every dovecot service), is it important to run the "doveadm purge -u $user" on the same host as $user is lo

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-06 Thread Jan-Frode Myklebust
On Mon, Feb 06, 2012 at 10:29:03PM +0200, Timo Sirainen wrote: > On 3.2.2012, at 14.25, Jan-Frode Myklebust wrote: > > > I now implemented this patch on our directors, and pointed postfix at them. > > No problem seen so far, but I'm still a

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-07 Thread Jan-Frode Myklebust
On Mon, Feb 06, 2012 at 10:01:03PM +0100, Jan-Frode Myklebust wrote: > > Your fsyncs can run over 60 seconds? > > Hopefully not.. maybe just me being confused by the error message about > "lmtp_proxy_output_timeout". After adding > http://hg.dovecot.org/dovecot-2.0/re

Re: [Dovecot] Performance of Maildir vs sdbox/mdbox

2012-02-09 Thread Jan-Frode Myklebust
On Thu, Feb 09, 2012 at 01:48:09AM +0200, Timo Sirainen wrote: > On 7.2.2012, at 10.25, Jan-Frode Myklebust wrote: > > > Feb 6 16:13:10 loadbalancer2 dovecot: lmtp(6601): Panic: file > > lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: > >

Re: [Dovecot] Issues with SIS and Backups - was Re: v2.1.0 status

2012-02-12 Thread Jan-Frode Myklebust
On Sun, Feb 12, 2012 at 05:58:20PM +0200, Timo Sirainen wrote: > > doveadm backup -u user@domain backup: > > And it would output the user's messages to stdout (or to some file). So it > would be similar to e.g. PostgreSQL's pg_dump. So only full backups, no incremental backups? Then what's the

[Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
We've been collecting some stats to see what kind of benefits UP/SquirrelMail's IMAP Proxy in for our SOGo webmail users. Dovecot is running in High-performance mode http://wiki2.dovecot.org/LoginProcess with authentication caching http://wiki2.dovecot.org/Authentication/Caching During the weekend

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 04:14:22PM +0200, Timo Sirainen wrote: > > The responstimes are not very fast, but they do seem to support > > the claim that an imapproxy isn't needed for dovecot. > > That's what I always suspected, but good to have someone actually test it. :) > This is with Maildir? Y

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 11:08:48AM -0800, Mark Moseley wrote: > > Out of curiosity, are you running dovecot locally on those webmail > servers as well, or is it talking to remote dovecot servers? The webmail servers are talking with dovecot director servers which in turn are talking with the back

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 09:57:31PM +0200, Timo Sirainen wrote: > > > > $ doveconf maildir_very_dirty_syncs > > maildir_very_dirty_syncs = yes > > > > but I don't think this gave the advantage I was expecting.. Was > > expecting this to move most iops to the index-luns, but the maildir > >

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-13 Thread Jan-Frode Myklebust
On Mon, Feb 13, 2012 at 01:24:25PM -0700, Michael M Slusarz wrote: > > Except you are most likely NOT leveraging the truly interesting part > of imapproxy - the ability to restore the IMAP connection state via > the XPROXYREUSE status response. This is a significant performance > improvement sinc

[Dovecot] pop3 not autocreating directory structure

2012-02-14 Thread Jan-Frode Myklebust
We use: mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln mail: mdbox:~/mdbox and I just noticed one of our newly provisioned users initially failed to pop her mails. I saw several of these: dovecot:: pop3(new.u...@example.net): Error: Couldn't open INBOX: Mailbox doesn't exi

[Dovecot] doveadm director proxy

2012-02-14 Thread Jan-Frode Myklebust
I'm trying to configure a doveadm service that will proxy trough our directors, following the recipie at: http://wiki2.dovecot.org/Director#Doveadm_server So on the backends I have: service doveadm { inet_listener { port = 24245

Re: [Dovecot] pop3 not autocreating directory structure

2012-02-15 Thread Jan-Frode Myklebust
On Wed, Feb 15, 2012 at 03:49:21AM +0200, Timo Sirainen wrote: > > > > Looking at the timestamps in the filesystem I see that the users home > > directory wasn't created before switcing to imap. > > > > Is this a know problem? > > Probably again a bug in your specific Dovecot version. :) I reme

Re: [Dovecot] Any possibility of running query after sucessful login?

2012-02-16 Thread Jan-Frode Myklebust
On Thu, Feb 16, 2012 at 09:41:52AM +0100, Jacek Osiecki wrote: > > I was just wondering if there is any possibility of running another > query after successful login - just to fill some extra field like > "last_login"? We touch a file in /var/log/activemailaccounts/$username on every successful

Re: [Dovecot] Any possibility of running query after sucessful login?

2012-02-16 Thread Jan-Frode Myklebust
On Thu, Feb 16, 2012 at 12:18:15PM +0100, Jacek Osiecki wrote: > > By the way, is such thing possible for other processess? For > example, I'd like to set in mysql table information that mail has > been delivered using lmtp. Would something like this work? > > protocol lmtp { > mail_plugins = $

Re: [Dovecot] Homedir vs locations vs mail_location?

2012-02-20 Thread Jan-Frode Myklebust
On Mon, Feb 20, 2012 at 09:57:15AM +0300, Alexander Chekalin wrote: > > 1. The homedir value points to the place where everything for the > user stored at, while mail_location is something (some place) where > mail stored at. if I deal with pure virtual users (all users are in > sql tables and no

Re: [Dovecot] IMAP-proxy or not with sogo webmail and dovecot backend

2012-02-22 Thread Jan-Frode Myklebust
On Tue, Feb 21, 2012 at 02:33:24PM +, Ed W wrote: > > I think the original question was still sensible. In your case it > seems like the ping times are identical between: > webmail -> imap-proxy > webmail -> imap server > > I think your results show that a proxy has little (or negati

<    1   2   3   4   5   >