On Wed, May 27, 2009 at 01:47:27PM -0600, Curtis wrote:
> For those wondering why we can't just commit to only using the provided
> utilities to manipulate queue files, it's because we are giving individual
> users the ability to view messages that were placed in the hold queue and
> release them up to 30 days after the messages were originally placed there.
If the files are guaranteed to only have a single recipient at the point
in your processing stream at which they are "held", you don't have to do
anything nearly so complex. Just retain the file's original name and
inode, by renaming it into a suitable directory tree in the same file-system.
Releasing can be accomplished by just moving it back into the maildrop queue
with its original name.
> While we could do this without moving the files out the hold queue, if we
> were to leave them there, the number of files in the one directory would
> cause us to take a performance hit all on it's own.
*Moving* the files does not require you to delete them or to change the
queue file name, just move them to a dedicated directory tree in the same
file-system.
> On our test system,
> that only hosts a few busy domains, the number of queue files that we
> collected from the hold queue on our test system, after just a few weeks, is
> over 200,000. On the production systems that will filter for hundreds of
> domains per machine, I expect that we'll see that many messages being held
> in the hold queue in a single day. Multiply that times 30 days, and I think
> it would be trouble.
I have a 30-day quarantine also, the files are kept in the original
file-system. On each of 6 servers, I have ~275,000 held files, ~13GB of
storage. It sounds like your scale is much larger.
A better design (working on this for our next gen quarantine) is I think
to deliver the quarantined messages to a custom SMTP or LMTP agent that
saves the message envelope and data in an ASCII form. Then messages
released by users from the quarantine are re-injected also via SMTP.
> I would be interested in seeing an option in Postfix to have the hold queue
> support multiple subdirectories where new subdirectories are created every X
> hours (or perhaps just daily) so that the number of files sitting in the
> queue do not get unmanagable.
Far better to not use HOLD. FILTER instead.
--
Viktor.
Disclaimer: off-list followups get on-list replies or get ignored.
Please do not ignore the "Reply-To" header.
To unsubscribe from the postfix-users list, visit
http://www.postfix.org/lists.html or click the link below:
<mailto:majord...@postfix.org?body=unsubscribe%20postfix-users>
If my response solves your problem, the best way to thank me is to not
send an "it worked, thanks" follow-up. If you must respond, please put
"It worked, thanks" in the "Subject" so I can delete these quickly.
