Aw: Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-04 Thread Infoomatic
> >> On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >>> That's probably the problem here. The user had LOTS of (duplicate!) > >>> mails in his inbox. I had the same problem with a corrupted IBM Domino mailfile which gave me lots of duplicates, however imapsync with the options "--useheader Date

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-03 Thread Jiri Bourek
On 3.7.2014 21:35, Timo Sirainen wrote: On 10.6.2014, at 14.05, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-03 Thread Timo Sirainen
On 10.6.2014, at 14.05, Charles Marcus wrote: > On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: >> That's probably the problem here. The user had LOTS of (duplicate!) >> mails in his inbox. > > Anyone ever found a reliable way to do this? > > It sure would be nice if dovecot could perform this on

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Charles Marcus
On 6/10/2014 12:32 PM, Ralf Hildebrandt wrote: * Charles Marcus: >On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >That's probably the problem here. The user had LOTS of (duplicate!) > >mails in his inbox. > >Anyone ever found a reliable way to do this? To duplicate the mails? 'This' refer

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
> Wasn't there a thread some days/weeks ago, that Pigeonhole behaves the > same by default and the poster asked how long the timeframe is Pigeonhole > remembers the ids? How would I go about enabling this? > Actually, I still wonder about whether or not the same message-id is > sufficient to

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
> The basic question is: what is a duplicate? > > I spot 100% duplicates within the same Maildir mailbox with a script > similiar to "fdupes" http://linux.die.net/man/1/fdupes . > Because an user may copy messages around, I scan one mailbox at a time. But with mdbox? Or mailboxes != Maildir form

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
* Charles Marcus : > On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >That's probably the problem here. The user had LOTS of (duplicate!) > >mails in his inbox. > > Anyone ever found a reliable way to do this? To duplicate the mails? Yeah: Just let fetchmail run unobserved for weeks, will fuck up

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:39, schrieb Steffen Kaiser: On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:17, schrieb Steffen Kaiser: The basic question is: what is a duplicate? However, neither script I wou

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Reindl Harald
Am 10.06.2014 15:39, schrieb Steffen Kaiser: > On Tue, 10 Jun 2014, Reindl Harald wrote: >> Am 10.06.2014 15:17, schrieb Steffen Kaiser: >>> The basic question is: what is a duplicate? >>> However, neither script I would call general enough for automatic processing > >> dbmail has just "suppress_

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:17, schrieb Steffen Kaiser: On Tue, 10 Jun 2014, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mai

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Reindl Harald
Am 10.06.2014 15:17, schrieb Steffen Kaiser: > On Tue, 10 Jun 2014, Charles Marcus wrote: >> On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: >>> That's probably the problem here. The user had LOTS of (duplicate!) >>> mails in his inbox. > >> Anyone ever found a reliable way to do this? > >> It su

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if

OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Charles Marcus
On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if dovecot could perform this on a per account and/or per maildir/mailbox case with a simple

Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-09 Thread Ralf Hildebrandt
* Timo Sirainen : > > Why would that happen? (dovecot 2.1.17) > > Difficult to say. It could be munmap()ing memory allocations or it > could be munmap()ing Dovecot index files. Weren't there equivalent > number of mmap() calls?.. > > BTW. In v2.2 the index file handling is faster for LDA/LMTP be

Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-09 Thread Timo Sirainen
On 8.6.2014, at 11.59, Ralf Hildebrandt wrote: > I observed several long running dovecot/lmtp processes hogging the > CPU. I then strace'd them (strace -c -p 6375) and found them > munmap()-ing a lot: > > % time seconds usecs/call callserrors syscall > -- --- ---

[Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-08 Thread Ralf Hildebrandt
I observed several long running dovecot/lmtp processes hogging the CPU. I then strace'd them (strace -c -p 6375) and found them munmap()-ing a lot: % time seconds usecs/call callserrors syscall -- --- --- - - 97.18 19.592537

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-14 Thread Greg Rivers
On Tue, 14 Jan 2014, Steffen Kaiser wrote: "FEATURE(`preserve_local_plus_detail')" is actually one of the first things I tried when I started working on this problem, but it doesn't quite work with the standard configuration: $ sendmail -bv -d21.12 gcr+xy...@badger.tharned.org -rule match

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-14 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Sun, 12 Jan 2014, Greg Rivers wrote: On Sat, 11 Jan 2014, Steffen wrote: I have: ... deliverable: mailer local, user uid+detail instead of "deliverable: mailer local, host detail, user gcr" Hmm, see http://etutorials.org/Server+Administration

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-12 Thread Greg Rivers
On Sat, 11 Jan 2014, Steffen wrote: I have: ... deliverable: mailer local, user uid+detail instead of "deliverable: mailer local, host detail, user gcr" Hmm, see http://etutorials.org/Server+Administration/Sendmail/Part+I+Build+and+Install/Chapter+4.+Configure+sendmail.cf+with+m4/FEATUREpreser

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-10 Thread Steffen
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Greg Rivers wrote: > On Fri, 10 Jan 2014, Steffen Kaiser wrote: > >> try sendmail -bv -d60.5 -d27.2 -d21.12 >> gcr+det...@badger.tharned.org >> >> - -d60.5 - trace map lookups - -d27.2 - traces processing of >> aliases and forwards - -d21.12 - trace

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-10 Thread Greg Rivers
On Fri, 10 Jan 2014, Steffen Kaiser wrote: try sendmail -bv -d60.5 -d27.2 -d21.12 gcr+det...@badger.tharned.org - -d60.5 - trace map lookups - -d27.2 - traces processing of aliases and forwards - -d21.12 - trace R line processing IMHO: If all map lookups return NOTFOUND, the detail is preserv

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-09 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Thu, 9 Jan 2014, Greg Rivers wrote: On Thu, 9 Jan 2014, Steffen Kaiser wrote: On Tue, 7 Jan 2014, Greg Rivers wrote: [snip] So for the archives, to get sieve's "envelope :detail ..." working with sendmail and dovecot LMTP, do the following:

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-09 Thread Greg Rivers
On Thu, 9 Jan 2014, Steffen Kaiser wrote: On Tue, 7 Jan 2014, Greg Rivers wrote: [snip] So for the archives, to get sieve's "envelope :detail ..." working with sendmail and dovecot LMTP, do the following: 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf 2) Add the foll

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 7 Jan 2014, Greg Rivers wrote: On Mon, 6 Jan 2014, I wrote: I found this[1] thread that describes the same problem with dovecot-LDA, but the solution (add X-Original-To: header) has no effect with LMTP. My sendmail LMTP configuration: FEA

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Greg Rivers
On Wed, 8 Jan 2014, Charles Marcus wrote: On 2014-01-08 2:27 PM, Greg Rivers wrote: Given that LMTP does in fact parse X-Original-To (or any other header of your choice) when lda_original_recipient_header is defined, I think one would say that dovecot LMTP does already support this natively.

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Greg Rivers
On Wed, 8 Jan 2014, Miquel van Smoorenburg wrote: On 8-01-14 5:46 PM, Charles Marcus wrote: On 2014-01-07 9:20 PM, Greg Rivers wrote: So for the archives, to get sieve's "envelope :detail ..." working with sendmail and dovecot LMTP, do the following: 1) Add "lda_original_recipient_header = X

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Miquel van Smoorenburg
On 8-01-14 5:46 PM, Charles Marcus wrote: On 2014-01-07 9:20 PM, Greg Rivers wrote: So for the archives, to get sieve's "envelope :detail ..." working with sendmail and dovecot LMTP, do the following: 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf 2) Add the following r

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Charles Marcus
On 2014-01-08 2:27 PM, Greg Rivers wrote: Given that LMTP does in fact parse X-Original-To (or any other header of your choice) when lda_original_recipient_header is defined, I think one would say that dovecot LMTP does already support this natively. So it's not really a hack, it's just a mat

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Greg Rivers
On Tue, 7 Jan 2014, Sean Kamath wrote: Glad to know my "for the archives" message(*) helped. :-) Indeed it did. Thanks! I was surprised to find that sendmail does not pass +detail during LMTP, even though the default EnvToL rewrite rule declared in the local LMTP mailer definition preserve

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-08 Thread Charles Marcus
On 2014-01-07 9:20 PM, Greg Rivers wrote: On Mon, 6 Jan 2014, I wrote: I found this[1] thread that describes the same problem with dovecot-LDA, but the solution (add X-Original-To: header) has no effect with LMTP. My sendmail LMTP configuration: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/d

Re: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-07 Thread Greg Rivers
On Mon, 6 Jan 2014, I wrote: I found this[1] thread that describes the same problem with dovecot-LDA, but the solution (add X-Original-To: header) has no effect with LMTP. My sendmail LMTP configuration: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') Sendmail's address test indica

[Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve

2014-01-06 Thread Greg Rivers
I found this[1] thread that describes the same problem with dovecot-LDA, but the solution (add X-Original-To: header) has no effect with LMTP. My sendmail LMTP configuration: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') Sendmail's address test indicates that sendmail is providing

Re: [Dovecot] dovecot-lmtp does not work

2013-05-31 Thread He Shiming
I discovered that the line is actually overridden by /etc/dovecot/conf.d/01-mail-stack-delivery.conf:protocols = imap pop3 sieve . Therefore the protocol is not up. I've modified this line and it worked. Thanks for you help. On Sat, Jun 1, 2013 at 9:34 AM, He Shiming wrote: > Thanks Andy. But I

Re: [Dovecot] dovecot-lmtp does not work

2013-05-31 Thread He Shiming
Thanks Andy. But I do have this line 'protocols = lmtp imap pop3' in dovecot.conf. This line doesn't contain 'sieve' either. Is it possible for other config file to override this line? On Sat, Jun 1, 2013 at 2:59 AM, Andy R wrote: > Hi there, > > Have you added 'lmtp' to the protocols line in do

Re: [Dovecot] dovecot-lmtp does not work

2013-05-31 Thread Andy R
Hi there, Have you added 'lmtp' to the protocols line in dovecot.conf ? It's not listed in your doveconf -n. IE :- # Protocols we want to be serving. #protocols = imap pop3 sieve protocols = imap pop3 sieve lmtp For logging, set "mail_debug = yes" (in /etc/dovecot/conf.d/10-logging.conf on

[Dovecot] dovecot-lmtp does not work

2013-05-31 Thread He Shiming
Dear Community, I've got a weird problem regarding lmtp setup with dovecot 2.0.19 on ubuntu 12.04.2 LTS. My reference of the configuration is at https://library.linode.com/email/postfix/postfix2.9.6-dovecot2.0.19-mysql , and my configuration is identical to it with the exception of opening the 110

Re: [Dovecot] Dovecot LMTP - Delivered-To header weirdness

2012-08-09 Thread Daniel Piddock
On 09/08/12 12:04, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide

Re: [Dovecot] Dovecot LMTP - Delivered-To header weirdness

2012-08-09 Thread Charles Marcus
On 2012-08-09 7:04 AM, Robert Schetterer wrote: Am 09.08.2012 12:26, schrieb Daniel Piddock: I'm not sure if this is a deliberate design decision or a technical limitation that I've missed. Please briefly explain if so :). Or a bug or feature request? as far i remember its a design decide d

Re: [Dovecot] Dovecot LMTP - Delivered-To header weirdness

2012-08-09 Thread Robert Schetterer
Am 09.08.2012 12:26, schrieb Daniel Piddock: > I'm not sure if this is a deliberate design decision or a technical > limitation that I've missed. Please briefly explain if so :). Or a bug > or feature request? as far i remember its a design decide dont know exim but it looks like max_rcpt=1 is

[Dovecot] Dovecot LMTP - Delivered-To header weirdness

2012-08-09 Thread Daniel Piddock
Hi, I'm not sure if this is a deliberate design decision or a technical limitation that I've missed. Please briefly explain if so :). Or a bug or feature request? When LMTP receives a mail with a single recipient it adds a Delivered-To header. However if the message is delivered in a batch that h

Re: [Dovecot] Dovecot lmtp

2010-12-03 Thread Benedetto Vassallo
Def. Quota Timo Sirainen : On Thu, 2010-12-02 at 16:23 +0100, Benedetto Vassallo wrote: The only think I can't set up is make dovecot-lmtp reading the .forward file in the user's home directory. I think I am missing something, becouse dovecot-lda read that file but don't do hard links when del

Re: [Dovecot] Dovecot lmtp

2010-12-02 Thread Timo Sirainen
On Thu, 2010-12-02 at 16:23 +0100, Benedetto Vassallo wrote: > The only think I can't set up is make dovecot-lmtp reading the > .forward file in the user's home directory. > I think I am missing something, becouse dovecot-lda read that file but > don't do hard links when deliver the mail. Neit

[Dovecot] Dovecot lmtp

2010-12-02 Thread Benedetto Vassallo
Hello to all, I am setting up a mail server using sendmail and dovecot 2.0.7 with maildir storage. I want to use dovecot lmtp as local mail delivery agent becouse when I send a message to multiple recipients it deliver the message to all recipients with hard links instead of store n copies o