> I've been investigating some recent slowness issues with our mail > servers and I noticed that the spamassassin database is getting > rather large. We process approximately 300,000 mails a day (or > more).
We do only a third of that Jason but I'm still having problems with capacity. I have filled spamc with debugging to help me figure out where the problem lies, and I think it has come down to database contention, or slow DNS, DCC, and Razor lookups. Whatever it is, I'm running out of spamd children. I have two boxes running spamd --max-children 60, and in bursty times every child is busy and spam leaks through unchecked. We receive far more "leaked" spam than false negatives: 5,000 out of 171,000 attempted in the past 48 hours. Could Jason, and others on the list who handle a large amount of email, report back on their setups? It might be quite a useful resource to have in the archives. I don't think it has been covered on this list before, but please set me straight if it has. In particular I am interested in: - how many boxes running spamd? - how many spamd children per box (spamd --max-children) - if Bayes is SQL, is it on the same or separate server as spamd, and are you replicating it to balance read load? - spamc timeout (spamc -t) - rbl_timeout - bayes_expiry_max_db_size - bayes_journal_max_size Until this morning, when something calamitous happened to it, I was using Berkeley for Bayes. That is why I am interested in the load on MySQL, since my database is on a separate box and is already handling the per-user configs (one select per message) and the statistics (one update per message). With autolearning on, and the default bayes_journal_max_size, the journal filled and was flushed every couple of minutes. Approximately how often should the journal flush itself? Is there any harm in having it happen every few minutes, or should I tune it up to an hour or so? > The bayes_token database is over 1.8 Gig at the moment. (Actually, > 1.8 Gig for the data, and 1.3 Gig for the index) Yikes. That is the kind of thing I need to avoid! Many, many thanks in advance. -- _________________________________________________________________________ Andrew Donkin Waikato University, Hamilton, New Zealand
