At Sun Jan 18 16:06:13 2004, Charles Gregory wrote: > A thought, and a suggestion: > > Thought: Some of the rules in 'rules du jour' look like they are fairly > 'stable'. There is no reason to be downloading 'backhair' or 'weeds' > everyday, is there? > > Suggestion: For frequent changers, like 'evilrules', how about setting up > a flag system where, for example, a single file is accessed for a > timestamp, and only if the timestamp is 'new' does the script perform the > various downloads. This way, most nights, there is ONE HTTP access, to get > the timestamp, and its a small file, rather than several big ones. > > This might require a 'central' site to keep the timestamp. But this would > work for all of Jennifer's rules, at least.....
HTTP provides a straightforward way to avoid repeated downloads of a file that hasn't changed, by sending If-Modified-Since requests. Unfortunately wget doesn't yet support this, though it is mentioned in its TODO file. (This is with wget 1.9.1, which is the current version.) Perhaps there's a Perl module that could do this.... Martin -- Martin Radford | "Only wimps use tape backup: _real_ [EMAIL PROTECTED] | men just upload their important stuff -o) Registered Linux user #9257 | on ftp and let the rest of the world /\\ - see http://counter.li.org | mirror it ;)" - Linus Torvalds _\_V ------------------------------------------------------- The SF.Net email is sponsored by EclipseCon 2004 Premiere Conference on Open Tools Development and Integration See the breadth of Eclipse activity. February 3-5 in Anaheim, CA. http://www.eclipsecon.org/osdn _______________________________________________ Spamassassin-talk mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/spamassassin-talk