Currently, when a daily.cvd is downloaded, its version and other such info is in the first N bytes of the whole file, which is quite big.
How about repeating that information in the HTTP response header, so it could be retrieved by an HTTP HEAD command, rather than having to do a massive GET, This would allow one to determine cheaply what version of a file is *actually* available from that mirror. I realize that although there already is a non-standard HTTP header line (CF-RAY) Cloudflare may not support customer defined headers. In that case, they certainly would support auxiliary files, something like daily.cvd.ver which contained the desired information (analogous to ".sig" files often associated with big files for security). If something like one of these were done, distributed mirrors would cause less trouble. Either it would be cheap to see if the mirrored version matched the DNS TXT file, or one could do away with that entirely, since it would be pretty cheap to just consult the mirror. Still another possibility would be to run a tiny DNS server on each mirror, and have freshclam do something like: dig @mirror current.cvd.clamav.net and then download from that *particular* mirror if appropriate. (Here the DNS TXT record would only be updated *after* the cvd file was.) The point of all these is to reduce the window of inconsistency that is inherent in all distributed systems which serve up related data -- if they don't apply the standard complex and expensive solutions, that is. _______________________________________________ clamav-users mailing list clamav-users@lists.clamav.net http://lists.clamav.net/cgi-bin/mailman/listinfo/clamav-users Help us build a comprehensive ClamAV guide: https://github.com/vrtadmin/clamav-faq http://www.clamav.net/contact.html#ml