Hi, with certain mails on FreeBSD 8.0 and SA 3.3.1 I have a performance problem:
[/var/amavis/tmp]# spamassassin -D -lint < /var/amavis/tmp/amavis-20100602T192227-44802/email.txt Jun 2 21:37:08.809 [50826] warn: The -l option has been deprecated and is no longer supported, ignoring. Jun 2 21:37:08.810 [50826] dbg: logger: adding facilities: all Jun 2 21:37:08.811 [50826] dbg: logger: logging level is DBG Jun 2 21:37:08.811 [50826] dbg: generic: SpamAssassin version 3.3.1 Jun 2 21:37:08.812 [50826] dbg: generic: Perl 5.010001, PREFIX=/usr/local, DEF_RULES_DIR=/usr/local/share/spamassassin, LOCAL_RULES_DIR=/usr/local/etc/mail/spamassassin, LOCAL_STATE_DIR=/var/db/spamassassin [...] Jun 2 21:37:15.626 [50826] dbg: rules: run_generic_tests - compiling eval code: body, priority 0 Jun 2 21:37:15.627 [50826] dbg: rules: compiled body tests Jun 2 21:37:20.524 [50826] dbg: rules: ran body rule __DOS_BODY_THU ======> got hit: "Thursday" Jun 2 21:37:22.444 [50826] dbg: rules: ran body rule __YOU_ASSIST ======> got hit: "your assistance" Jun 2 21:37:26.018 [50826] dbg: rules: ran body rule __FILL_THIS_FORM_PARTIAL ======> got hit: "Tel : " Jun 2 21:37:26.042 [50826] dbg: rules: ran body rule __FILL_THIS_FORM_PARTIAL ======> got hit: "Tel : " Jun 2 21:37:26.424 [50826] dbg: rules: ran body rule __DOS_BODY_TUE ======> got hit: "Tuesday" Jun 2 21:37:27.410 [50826] dbg: rules: ran body rule __PLS_REVIEW ======> got hit: "Please see attached" Jun 2 21:37:33.503 [50826] dbg: rules: ran body rule __DOS_BODY_FRI ======> got hit: "Friday" Jun 2 21:37:37.334 [50826] dbg: rules: ran body rule __SUBSCRIPTION_INFO ======> got hit: "Register" Jun 2 21:37:37.409 [50826] dbg: rules: ran body rule __HAS_ANY_EMAIL ======> got hit: "s...@vodafone.c" Jun 2 21:37:37.885 [50826] dbg: rules: ran body rule __NONEMPTY_BODY ======> got hit: "R" Jun 2 21:37:43.231 [50826] dbg: rules: ran body rule __HUSH_HUSH ======> got hit: "confidential" Jun 2 21:37:44.008 [50826] dbg: rules: running uri tests; score so far=0 [...] Jun 2 21:37:45.723 [50826] dbg: learn: initializing learner Jun 2 21:37:45.789 [50826] dbg: check: is spam? score=0.012 required=5 Jun 2 21:37:45.790 [50826] dbg: check: tests=HTML_FONT_SIZE_LARGE,HTML_MESSAGE,T_FILL_THIS_FORM Jun 2 21:37:45.791 [50826] dbg: check: subtests=__ANY_TEXT_ATTACH,__ANY_TEXT_ATTACH_DOC,__COMMENT_EXISTS,__CT,_ _CTYPE_HAS_BOUNDARY,__CTYPE_MULTIPART_ALT,__CTYPE_MULTIPART_ANY,__DKIM_D EPENDABLE,__DOS_BODY_FRI,__DOS_BODY_THU,__DOS_BODY_TUE,__DOS_HAS_ANY_URI ,__DOS_RCVD_WED,__DOS_REF_2_WK_DAYS,__DOS_REF_NEXT_WK_DAY,__DOS_RELAYED_ EXT,__FILL_THIS_FORM_PARTIAL,__FILL_THIS_FORM_PARTIAL,__FILL_THIS_FORM_P ARTIAL_RAW,__FILL_THIS_FORM_PARTIAL_RAW,__FILL_THIS_FORM_PARTIAL_RAW,__F ILL_THIS_FORM_PARTIAL_RAW,__FILL_THIS_FORM_PARTIAL_RAW,__FILL_THIS_FORM_ PARTIAL_RAW,__FILL_THIS_FORM_PARTIAL_RAW,__FILL_THIS_FORM_PARTIAL_RAW,__ HAS_ANY_EMAIL,__HAS_ANY_URI,__HAS_DATE,__HAS_MESSAGE_ID,__HAS_MIMEOLE,__ HAS_MSGID,__HAS_RCVD,__HAS_SUBJECT,__HS_SUBJ_RE_FW,__HUSH_HUSH,__IMS_MSG ID,__IS_EXCH,__LAST_EXTERNAL_RELAY_NO_AUTH,__LAST_UNTRUSTED_RELAY_NO_AUT H,__MIME_HTML,__MIME_QP,__MIME_VERSION,__NONEMPTY_BODY,__PLS_REVIEW,__RC VD_IN_2WEEKS,__SANE_MSGID,__SUBJ_RE,__SUBSCRIPTION_INFO,__TAG_EXISTS_BOD Y,__TAG_EXISTS_HEAD,__TAG_EXISTS_HTML,__TAG_EXISTS_META,__TOCC_EXISTS,__ TVD_MIME_ATT_TP,__YOU_ASSIST Jun 2 21:37:45.793 [50826] dbg: timing: total 36840 ms - init: 3827 (10.4%), parse: 43 (0.1%), extract_message_metadata: 822 (2.2%), get_uri_detail_list: 178 (0.5%), tests_pri_-1000: 212 (0.6%), compile_gen: 538 (1.5%), compile_eval: 79 (0.2%), tests_pri_-950: 52 (0.1%), tests_pri_-900: 35 (0.1%), tests_pri_-400: 392 (1.1%), check_bayes: 359 (1.0%), tests_pri_0: 30780 (83.6%), dkim_load_modules: 99 (0.3%), check_dkim_signature: 20 (0.1%), check_dkim_adsp: 13 (0.0%), check_spf: 81 (0.2%), poll_dns_idle: 0.57 (0.0%), check_dcc: 240 (0.7%), check_pyzor: 2 (0.0%), tests_pri_500: 258 (0.7%), tests_pri_1000: 61 (0.2%), total_awl: 28 (0.1%), check_awl: 6 (0.0%), update_awl: 4 (0.0%), learn: 118 (0.3%) [/var/amavis/tmp]# So the body tests take ~ 30 of 37 seconds. It's not a load problem, under load it takes >2 minutes and it is reproducable with certain mails only. Any idea where to start? Thanks, Helmut -- No Swen today, my love has gone away My mailbox stands for lorn, a symbol of the dawn
