Re: Deleting Duplicates

2008-05-06 Thread Russell L. Harris
* Mike Loiterman <[EMAIL PROTECTED]> [080507 01:07]: > I have an mbox file with 3633 messages. Every single message has a > duplicate. I understand that I can easily delete duplicates with the > tag ~=. The problem that I have is that this only works with messages > with a unique message I

Deleting Duplicates

2008-05-06 Thread Mike Loiterman
I have an mbox file with 3633 messages. Every single message has a duplicate. I understand that I can easily delete duplicates with the tag ~=. The problem that I have is that this only works with messages with a unique message ID. Sadly, none of these messages has a unique message ID,

Re: procmail script for deleting duplicates

2002-04-24 Thread Edmund GRIMLEY EVANS
Sorry to continue this off-topic thread, but Volker Kuhlmann pointed out a bug and some things to improve in the script I sent out, so I'm sending out a new version for the record (i.e. people searching the list archives with Google). > :0 > md5sum=| perl -e 'while (($_ = <>) && !/^\r?\n$/) { if

Re: procmail script for deleting duplicates

2002-04-19 Thread David T-G
Rob -- ...and then Feztaa said... % % Alas! David T-G spake thus: % > % A better solution is simply to have duplicates sent to ~/mail/duplicates % > % instead of /dev/null, so that way you know what's being filtered. % > % > ... but you'd still have the same problem even though you could manual

Re: procmail script for deleting duplicates

2002-04-19 Thread Rob 'Feztaa' Park
--Q0rSlbzrZN6k9QnT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Alas! David T-G spake thus: > % A better solution is simply to have duplicates sent to ~/mail/duplicates > % instead of /dev/null, so that way you know what's bei

Re: procmail script for deleting duplicates

2002-04-19 Thread David T-G
Rob, et al -- ...and then Feztaa said... % % Alas! Edmund GRIMLEY EVANS spake thus: % > Pointless paranoia really, but imagine this: someone could subscribe ... % > first, the real messages could be deleted by your formail script. % % A better solution is simply to have duplicates sent to ~/mai

Re: procmail script for deleting duplicates

2002-04-18 Thread Rob 'Feztaa' Park
--OXfL5xGRrasGEqWY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Alas! Edmund GRIMLEY EVANS spake thus: > Pointless paranoia really, but imagine this: someone could subscribe > to the same mailing list as you, with an address s

Re: procmail script for deleting duplicates

2002-04-18 Thread Nicolas Rachinsky
* Edmund GRIMLEY EVANS <[EMAIL PROTECTED]> [2002-04-17 23:59:39 +0100]: > David Kelly <[EMAIL PROTECTED]>: > > > Somehow I've missed the start of Edmund's .procmailrc. But why wouldn't > > one do it this way rather than MD5 all that stuff manually? Have you > > found the message-id header to be t

Re: procmail script for deleting duplicates

2002-04-18 Thread David Kelly
Edmund GRIMLEY EVANS writes: > David Kelly <[EMAIL PROTECTED]>: > > > Somehow I've missed the start of Edmund's .procmailrc. But why wouldn't > > one do it this way rather than MD5 all that stuff manually? Have you > > found the message-id header to be that unreliable? > > Pointless paranoia rea

Re: procmail script for deleting duplicates

2002-04-18 Thread Edmund GRIMLEY EVANS
David Kelly <[EMAIL PROTECTED]>: > Somehow I've missed the start of Edmund's .procmailrc. But why wouldn't > one do it this way rather than MD5 all that stuff manually? Have you > found the message-id header to be that unreliable? Pointless paranoia really, but imagine this: someone could subscr

Re: procmail script for deleting duplicates

2002-04-17 Thread Rocco Rutte
Hi, * Edmund GRIMLEY EVANS [04/17/02 22:31:00 CEST] wrote: > The start of my .procmailrc is below. The in-line Perl script removes > all header fields except Date, From, Subject, To and Cc. MD5 sums are > appended to $MAILDIR/MD5, so you should remove the beginning of that > file from time to tim

procmail script for deleting duplicates

2002-04-17 Thread Edmund GRIMLEY EVANS
Nicolas Rachinsky <[EMAIL PROTECTED]>: > > I think getmail does better than fetchmail if the network goes down > > while it's polling the server: fetchmail has an annoying habit of > > losing its fetchids when this happens, resulting in the delivery of > > several hundred duplicate messages in my

Re: procmail script for deleting duplicates

2002-04-17 Thread David Kelly
On Wed, Apr 17, 2002 at 10:42:46PM +0200, Nicolas Rachinsky wrote: > * Edmund GRIMLEY EVANS <[EMAIL PROTECTED]> [2002-04-17 21:31:00 +0100]: > > Nicolas Rachinsky <[EMAIL PROTECTED]>: > > > > > > I think getmail does better than fetchmail if the network goes down > > > > while it's polling the se

Re: procmail script for deleting duplicates

2002-04-17 Thread Nicolas Rachinsky
* Edmund GRIMLEY EVANS <[EMAIL PROTECTED]> [2002-04-17 21:31:00 +0100]: > Nicolas Rachinsky <[EMAIL PROTECTED]>: > > > > I think getmail does better than fetchmail if the network goes down > > > while it's polling the server: fetchmail has an annoying habit of > > > losing its fetchids when this