Hello Users,
i have a problem with the autolearning function on my server. Mails
submitted to spamd get autolearn=failed, but mail sent to spamassassin
or sa-learn will get learned correctly.
I am running SA 3.2.3 with Bayes and AWL on the MySQL backend.
The server is running as user vscan with start options -d -m 10 -x -q
--socketpath=/var/run/spam -u vscan
[EMAIL PROTECTED]:~/spam> sa-learn --clear
[EMAIL PROTECTED]:~/spam> sa-learn --sync
[EMAIL PROTECTED]:~/spam> sa-learn --dump magic
0.000 0 3 0 non-token data: bayes db version
0.000 0 0 0 non-token data: nspam
0.000 0 0 0 non-token data: nham
0.000 0 0 0 non-token data: ntokens
0.000 0 2147483647 0 non-token data: oldest atime
0.000 0 0 0 non-token data: newest atime
0.000 0 0 0 non-token data: last journal
sync atime
0.000 0 0 0 non-token data: last expiry
atime
0.000 0 0 0 non-token data: last expire
atime delta
0.000 0 0 0 non-token data: last expire
reduction count
[EMAIL PROTECTED]:~/spam> spamc -c --headers -U /var/run/spam <
1390002.msg.msg
8.8/4.0
[EMAIL PROTECTED]:~/spam> sa-learn --dump magic
0.000 0 3 0 non-token data: bayes db version
0.000 0 0 0 non-token data: nspam
0.000 0 0 0 non-token data: nham
0.000 0 0 0 non-token data: ntokens
0.000 0 2147483647 0 non-token data: oldest atime
0.000 0 0 0 non-token data: newest atime
0.000 0 0 0 non-token data: last journal
sync atime
0.000 0 0 0 non-token data: last expiry
atime
0.000 0 0 0 non-token data: last expire
atime delta
0.000 0 0 0 non-token data: last expire
reduction count
Nothing has happened in the database using spamc/spamd..
[EMAIL PROTECTED]:~/spam> spamassassin < 1390002.msg.msg
Received: from localhost by h9902.serverkompetenz.net
with SpamAssassin (version 3.2.3);
Thu, 06 Sep 2007 12:12:36 +0200
X-Spam-Flag: YES
X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on
h9902.serverkompetenz.net
X-Spam-Level: *********************
X-Spam-Status: Yes, score=21.3 required=4.0 tests=DRUGS_DIET=0.001,
DRUGS_ERECTILE=0.646,DRUGS_MUSCLE=0.001,FB_CIALIS_LEO3=2.815,FB_GVR=0.00
1,
HS_INDEX_PARAM=0.001,MISSING_DATE=0.001,MISSING_HB_SEP=2.5,
MISSING_HEADERS=1.581,MISSING_MID=0.001,MISSING_SUBJECT=1.285,NO_RECEIVE
D=0,
URIBL_BLACK=1.961,URIBL_JP_SURBL=2.857,URIBL_OB_SURBL=3,URIBL_SC_SURBL=2
.523,
URIBL_WS_SURBL=2.1
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="----------=_46DFD294.09BCF876"
This is a multi-part message in MIME format.
------------=_46DFD294.09BCF876
...message clipped...
------------=_46DFD294.09BCF876--
[EMAIL PROTECTED]:~/spam> sa-learn --dump magic
0.000 0 3 0 non-token data: bayes db version
0.000 0 1 0 non-token data: nspam
0.000 0 0 0 non-token data: nham
0.000 0 279 0 non-token data: ntokens
0.000 0 1189073555 0 non-token data: oldest atime
0.000 0 1189073555 0 non-token data: newest atime
0.000 0 0 0 non-token data: last journal
sync atime
0.000 0 0 0 non-token data: last expiry
atime
0.000 0 0 0 non-token data: last expire
atime delta
0.000 0 0 0 non-token data: last expire
reduction count
spamassassin DID update the database..
When I run spamd with -D enabled, I get
Sep 6 11:03:04 h9902 spamd[9924]: learn: auto-learn: currently using
scoreset 3, recomputing score based on scoreset 1
Sep 6 11:03:04 h9902 spamd[9924]: learn: auto-learn: message score:
10.05, computed score for autolearn: 6.662
Sep 6 11:03:04 h9902 spamd[9924]: learn: auto-learn? ham=-1, spam=6,
body-points=6.662, head-points=6.662, learned-points=5
Sep 6 11:03:04 h9902 spamd[9924]: learn: auto-learn? yes, spam (6.662 >
6)
Sep 6 11:03:04 h9902 spamd[9924]: learn: initializing learner
Sep 6 11:03:04 h9902 spamd[9924]: learn: initializing learner
Sep 6 11:03:04 h9902 spamd[9924]: check: is spam? score=10.05
required=4
Sep 6 11:03:04 h9902 spamd[9924]: check:
tests=BAYES_95,DRUGS_DIET,DRUGS_ERECTILE,DRUGS_MUSCLE,FB_CIALIS_LEO3,FB_
GVR,FROM_LOCAL_NOVOWEL,HS_INDEX_PARAM,HTML_MES
SAGE
Sep 6 11:03:04 h9902 spamd[9924]: check:
subtests=__BAT_BOUNDARY,__CT,__CTYPE_HAS_BOUNDARY,__CTYPE_MULTIPART_ALT,
__DOS_HAS_ANY_URI,__DOS_RCVD_THU,__DRUGS_DIET1
,__DRUGS_DIET_PHEN,__DRUGS_ERECTILE1,__DRUGS_ERECTILE10,__DRUGS_ERECTILE
3,__DRUGS_ERECTILE_C,__DRUGS_ERECTILE_V,__DRUGS_MUSCLE1,__FH_HAS_XPRIORI
TY,__FRAUD_DBI,_
_HAS_ANY_URI,__HAS_MSGID,__HAS_RCVD,__HAS_SUBJECT,__HAS_X_MAILER,__LAST_
UNTRUSTED_RELAY_NO_AUTH,__LOCAL_PP_NONPPURL,__MIME_HTML,__MIME_VERSION,_
_MISSING_REF,__M
SGID_OK_DIGITS,__MSGID_OK_HOST,__NAKED_TO,__NONEMPTY_BODY,__SANE_MSGID,_
_SARE_BODY_BLNK_5_100,__SARE_HAS_BG_COLOR,__SARE_HAS_FG_COLOR,__SARE_HEA
D_MIME_VALID,__S
ARE_HTML_HAS_A,__SARE_HTML_HAS_BR,__SARE_HTML_HAS_FONT,__SARE_HTML_HAS_P
,__SARE_HTML_HAS_TITLE,__SARE_META_MURTY3,__SARE_SPEC_LRD_COST4,__SARE_S
PEC_PROLEO3,__SA
RE_URI_ANY,__SARE_WHITE_BG_COLOR,__TAG_EXISTS_BODY,__TAG_EXISTS_HEAD,__T
AG_EXISTS_HTML,__THEBAT_MUA,__TOCC_EXISTS
Sep 6 11:03:04 h9902 spamd[9924]: spamd: identified spam (10.1/4.0) for
(unknown):65 in 1.0 seconds, 4368 bytes.
Sep 6 11:03:04 h9902 spamd[9924]: spamd: result: Y 10 -
BAYES_95,DRUGS_DIET,DRUGS_ERECTILE,DRUGS_MUSCLE,FB_CIALIS_LEO3,FB_GVR,FR
OM_LOCAL_NOVOWEL,HS_INDEX_PARAM,HTML_MESSAGE
scantime=1.0,size=4368,user=(unknown),uid=65,required_score=4.0,rhost=lo
calhost,raddr=127.0.0.1,rport=/var/run/spam,mid=<817429475.4380830581998
[EMAIL PROTECTED]>,bayes=0.980617,autolearn=unavailable
I do see nothing special there, apart from the autolearn=unavailable.
There are no errors due to permissions, vscan homedir amd /tmp are
writable, the database works and is writable by the user.
This is my local.cf (score changes left out) - it does --lint!
trusted_networks 81.169.178.43
internal_networks 81.169.178.43
required_score 4
score ALL_TRUSTED 0
add_header all Status _YESNO_, score=_SCORE_ required=_REQD_
tests=_TESTSSCORES(,)_
ok_locales en de
use_bayes 1
bayes_min_ham_num 50
bayes_min_spam_num 50
bayes_use_hapaxes 0
use_auto_whitelist 1
user_awl_dsn dbi:mysql:spamassassin
user_awl_sql_username spam
user_awl_sql_password hamster
auto_whitelist_factory Mail::SpamAssassin::SQLBasedAddrList
#bayes_path /tmp/bayes
bayes_sql_dsn dbi:mysql:spamassassin
bayes_sql_username spam
bayes_sql_password hamster
bayes_store_module Mail::SpamAssassin::BayesStore::SQL
bayes_sql_override_username spam
bayes_auto_learn_threshold_nonspam -1
bayes_auto_learn_threshold_spam 6
I have already tried commenting out both SQL modules, running DB_File
instead, commenting out the thresholds, checking the number of mysql
connections, nothing worked.
I have upgraded Mail::Spamassassin to the latest version and forced a
rebuild.
Do you have any ideas what I might try? How does the spamd server work
differently from a manual call of spamassassin? Is there any more
debugging I can get from the daemon?
Cheers,
Stefan
