While major mirror can use HTTP1.1 if no proxy, Squid poxies don't do 1.1 on other than experimental basis. As to whether wget does use it or not I will have to check Don't assume either way
------Original Message------ From: Aristotle Pagaltzis To: module-authors@perl.org Sent: Mar 28, 2010 11:45 PM Subject: Re: Trimming the CPAN - "Automatic Purging" * Dana Hudes <dhu...@hudes.org> [2010-03-29 04:30]: > Using http for this is inefficient It makes for slower file > transfer because you keep rerunning path mtu probes and tcp > slow start It makes extra socket handles opening and closing Errm, you missed the last decade. (HTTP/1.1 has keep-alive and pipelining and it’s 10 years old now.) > In the case of CPAN you don't have to go the log route. If the > mirror knows it last synch time it can use rsync to get the > modlist et al and import to SQLITE then query by date to come > up with the list of files to fetch -- via ftp. Say what? Stat via rsync to feed an SQLite database that drives an FTP transfer? Could you even possibly come up with a more Rube-Goldbergian construction? Regards, -- Aristotle Pagaltzis // <http://plasmasturm.org/> Sent from my BlackBerry® smartphone with Nextel Direct Connect
