Re: consoliate mail archives with duplicate messages

[Rick Thomas <rbthomas55@pobox.com>]

On Feb 19, 2008, at 3:53 AM, Johann Spies wrote:

> > Over the years, every time I have reinstalled Debian, I have saved  
> > the
> > mail files.  Now I have a dozen or more files, with many duplicate
> > messages.
> >
> > Is there an archiving utility or other reasonably simple approach
> > whereby I can process these mail files to (1) considate them into a
> > single file or archive and (2) eliminate duplicate messages?
>
> I would unpack those files into a Maildir and if you then have
> duplicate emails you can remove them with fdupes.

That will find emails that are bit-for-bit identical.

For emails that are the same except for some delivery headers, you  
may need to write a script that compares
Message-ID: headers.

Rick