Aw: Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-04 Thread Infoomatic
> >> On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >>> That's probably the problem here. The user had LOTS of (duplicate!) > >>> mails in his inbox. I had the same problem with a corrupted IBM Domino mailfile which gave me lots of duplicates, however imapsync with the options "--useheader Date

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-03 Thread Jiri Bourek
On 3.7.2014 21:35, Timo Sirainen wrote: On 10.6.2014, at 14.05, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-07-03 Thread Timo Sirainen
On 10.6.2014, at 14.05, Charles Marcus wrote: > On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: >> That's probably the problem here. The user had LOTS of (duplicate!) >> mails in his inbox. > > Anyone ever found a reliable way to do this? > > It sure would be nice if dovecot could perform this on

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Charles Marcus
On 6/10/2014 12:32 PM, Ralf Hildebrandt wrote: * Charles Marcus: >On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >That's probably the problem here. The user had LOTS of (duplicate!) > >mails in his inbox. > >Anyone ever found a reliable way to do this? To duplicate the mails? 'This' refer

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
> Wasn't there a thread some days/weeks ago, that Pigeonhole behaves the > same by default and the poster asked how long the timeframe is Pigeonhole > remembers the ids? How would I go about enabling this? > Actually, I still wonder about whether or not the same message-id is > sufficient to

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
> The basic question is: what is a duplicate? > > I spot 100% duplicates within the same Maildir mailbox with a script > similiar to "fdupes" http://linux.die.net/man/1/fdupes . > Because an user may copy messages around, I scan one mailbox at a time. But with mdbox? Or mailboxes != Maildir form

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Ralf Hildebrandt
* Charles Marcus : > On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: > >That's probably the problem here. The user had LOTS of (duplicate!) > >mails in his inbox. > > Anyone ever found a reliable way to do this? To duplicate the mails? Yeah: Just let fetchmail run unobserved for weeks, will fuck up

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:39, schrieb Steffen Kaiser: On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:17, schrieb Steffen Kaiser: The basic question is: what is a duplicate? However, neither script I wou

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Reindl Harald
Am 10.06.2014 15:39, schrieb Steffen Kaiser: > On Tue, 10 Jun 2014, Reindl Harald wrote: >> Am 10.06.2014 15:17, schrieb Steffen Kaiser: >>> The basic question is: what is a duplicate? >>> However, neither script I would call general enough for automatic processing > >> dbmail has just "suppress_

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Reindl Harald wrote: Am 10.06.2014 15:17, schrieb Steffen Kaiser: On Tue, 10 Jun 2014, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mai

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Reindl Harald
Am 10.06.2014 15:17, schrieb Steffen Kaiser: > On Tue, 10 Jun 2014, Charles Marcus wrote: >> On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: >>> That's probably the problem here. The user had LOTS of (duplicate!) >>> mails in his inbox. > >> Anyone ever found a reliable way to do this? > >> It su

Re: OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 10 Jun 2014, Charles Marcus wrote: On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if

OT - Finding/removing duplicate emails - WAS: Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-10 Thread Charles Marcus
On 6/9/2014 5:44 PM, Ralf Hildebrandt wrote: That's probably the problem here. The user had LOTS of (duplicate!) mails in his inbox. Anyone ever found a reliable way to do this? It sure would be nice if dovecot could perform this on a per account and/or per maildir/mailbox case with a simple

Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-09 Thread Ralf Hildebrandt
* Timo Sirainen : > > Why would that happen? (dovecot 2.1.17) > > Difficult to say. It could be munmap()ing memory allocations or it > could be munmap()ing Dovecot index files. Weren't there equivalent > number of mmap() calls?.. > > BTW. In v2.2 the index file handling is faster for LDA/LMTP be

Re: [Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-09 Thread Timo Sirainen
On 8.6.2014, at 11.59, Ralf Hildebrandt wrote: > I observed several long running dovecot/lmtp processes hogging the > CPU. I then strace'd them (strace -c -p 6375) and found them > munmap()-ing a lot: > > % time seconds usecs/call callserrors syscall > -- --- ---

[Dovecot] dovecot/lmtp munmap()-ing a lot

2014-06-08 Thread Ralf Hildebrandt
I observed several long running dovecot/lmtp processes hogging the CPU. I then strace'd them (strace -c -p 6375) and found them munmap()-ing a lot: % time seconds usecs/call callserrors syscall -- --- --- - - 97.18 19.592537