spamd is running on an old 400Mhz iMac, using MySQL for its bayes database, which look like this...

sa-learn --dump magic
0.000          0          3          0  non-token data: bayes db version
0.000          0       1851          0  non-token data: nspam
0.000          0      28155          0  non-token data: nham
0.000          0     157801          0  non-token data: ntokens
0.000          0 1121701472          0  non-token data: oldest atime
0.000          0 1124474721          0  non-token data: newest atime
0.000 0 0 0 non-token data: last journal sync atime 0.000 0 1124474715 0 non-token data: last expiry atime 0.000 0 2764800 0 non-token data: last expire atime delta 0.000 0 1178 0 non-token data: last expire reduction count

Latest attempt at bayes expire showed the following...

[10958] dbg: bayes: bayes journal sync starting
[10958] dbg: bayes: bayes journal sync completed
[10958] dbg: bayes: expiry starting
[10958] dbg: bayes: expiry check keep size, 0.75 * max: 112500
[10958] dbg: bayes: token count: 157756, final goal reduction size: 45256 [10958] dbg: bayes: first pass? current: 1124474653, Last: 1124474284, atime: 2764800, count: 1178, newdelta: 71966, ratio: 38.4176570458404, period: 43200 [10958] dbg: bayes: can't use estimation method for expiry, unexpected result, calculating optimal atime delta (first pass)
[10958] dbg: bayes: expiry max exponent: 9
[10958] dbg: bayes: atime_token reduction
[10958] dbg: bayes: ========_===============
[10958] dbg: bayes: 43200_150460
[10958] dbg: bayes: 86400_145695
[10958] dbg: bayes: 172800_140981
[10958] dbg: bayes: 345600_127105
[10958] dbg: bayes: 691200_106160
[10958] dbg: bayes: 1382400_68983
[10958] dbg: bayes: 2764800_0
[10958] dbg: bayes: 5529600_0
[10958] dbg: bayes: 11059200_0
[10958] dbg: bayes: 22118400_0
[10958] dbg: bayes: couldn't find a good delta atime, need more token difference, skipping expire
[10958] dbg: bayes: expiry completed

In my spamd.log, I noticed lots of problems early to day with a perl crash, lots of child timeouts, etc. that started with this..


Fri Aug 19 09:50:11 2005 [6770] error: child processing timeout at / usr/bin/spamd line 1089, <GEN43> line 41.

(that was with a 10 minute timeout, message processing started at 9:40.

I ended up with the max number of spamd child processes being created, each one simultaneously timing ot on bayes_expire (shouldn't only one try to do it at a time?).

I've turned off auto_expire for now, so I can investigate over the next few days how long it actually takes, but there does seem to be a bug if multiple spamd clients are trying to do bayes_expire simultaneously.

--
Steve Martin                              http://www.cheezmo.com/
Smart Calibration, LLC           http://www.smartcalibration.com/
The Widescreen Movie Center            http://www.widemovies.com/
Letterboxed Movie TV Schedule  http://www.widemovies.com/lbx.html

Reply via email to