Am 07.02.2014 07:09, schrieb Axb:
On 02/07/2014 03:04 AM, Kevin A. McGrail wrote:
On 2/6/2014 8:32 PM, Dave Warren wrote:
On 2014-02-06 17:17, John Hardin wrote:
On Thu, 6 Feb 2014, Kevin A. McGrail wrote:
I've discussed it with Alex a bit but one of my next ideas for the
Rules QA process is the following:
- we measure and report on metrics for the rules that are promoted
such as rank (existing), computational expense, time spent on rule.
I assume meta rules would combine the expense of their components?
Sounds interesting!
How about if one or more components were called more by more than one
meta-rule? It's perhaps not entirely fair to divide it evenly, since
that might imply that removing the metarule would kill off that CPU
usage.
Without triple checking the code, my 99.9% belief is Rules are cached.
Calling them multiple times does not trigger a re-check.
duplicate rules only get loaded once, it "only" costs time/cpu cycles
so the fewer duplicates we have the faster we start a spamd or load
rules when running spamasassin.
see begimning of output when during "spamassassin --lint -D rules"
Hi list,
I hope I triggered a constructive and useful discussion here.
In between I realized my data was skewed and I wanted to apologize for that.
The peak in load happened when I rolled out the rule-set which was
running fine on one machine to the whole cluster of 4.
I immediately blamed it on the upstream changes (sa-update) which I
recklessly incorporated last minute.
It turns out that I would have run into the same problems with the
thoroughly tested ruleset without the updates.
The reason is that the load-balancing used in this scenario is dynamic
and not round-robin as I assumed, so the other servers took the load of
the one being tested :(
That being said, it would obviously be a great improvement if I could
assess the impact of a specific ruleset before I start using it on live
data (~40M/d).
--
Torge Husfeldt
Senior Anti-Abuse Engineer
Zentrales Abuse-Department (1&1 GMX Web.de)
1&1 Internet AG | Brauerstraße 50 | 76135 Karlsruhe | Germany
Phone: +49 721 91374-4795 | Fax: +49 721 91374-2982
E-Mail: torge.husfe...@1und1.de | Web: www.1und1.de
Hauptsitz Montabaur, Amtsgericht Montabaur, HRB 6484
Vorstand: Ralph Dommermuth, Frank Einhellinger, Robert Hoffmann, Andreas
Hofmann, Markus Huhn, Hans-Henning Kettler, Uwe Lamnek, Jan Oetjen, Christian
Würst
Aufsichtsratsvorsitzender: Michael Scheeren
Member of United Internet
Diese E-Mail kann vertrauliche und/oder gesetzlich geschützte Informationen
enthalten. Wenn Sie nicht der bestimmungsgemäße Adressat sind oder diese E-Mail
irrtümlich erhalten haben, unterrichten Sie bitte den Absender und vernichten
Sie diese E-Mail. Anderen als dem bestimmungsgemäßen Adressaten ist untersagt,
diese E-Mail zu speichern, weiterzuleiten oder ihren Inhalt auf welche Weise
auch immer zu verwenden.
This E-Mail may contain confidential and/or privileged information. If you are
not the intended recipient of this E-Mail, you are hereby notified that saving,
distribution or use of the content of this E-Mail in any way is prohibited. If
you have received this E-Mail in error, please notify the sender and delete the
E-Mail.
