I was tracing into why sources.gentoo.org is so slow at times, and gives errors, timeouts etc. I found that there is wget being used against the site, with a lot of rapid-fire requests for the *checkout* URLs - most often for entire directories. And very often, right when wget is being used, the sources.g.o performance sucks badly.
The wget requests account for 25-30% of the daily requests to sources.gentoo.org. It's meant for browsing, not pulling. If you are pulling multiple files, or some file on a regular basis, you should be using the anoncvs/anonsvn systems instead. export ANON=":pserver:[EMAIL PROTECTED]:/var/cvsroot" Listing the files for a package: # cvs -z0 -d $ANON rls gentoo-x86/$CAT/$PN/ Grabbing an entire package: # T=`mktemp -d` # cvs -z0 -d $ANON co -d $T gentoo-x86/$CAT/$PN Grabbing a single file, without a temp: # cvs -z0 -d $ANON co -p gentoo-x86/$CAT/$PN/$FILENAME >$OUTPUTFILE Pursuant to the above, the any useragent matching /^Wget/ will be blocked from the 'gentoo' and 'gentoo-x86' repos of sources.gentoo.org as of July 14th. Either change to using the proper anonymous service, or change your useragent to describe what you are doing with the service, so that I can specifically ban your user-agent if it's causing too much load. -- Robin Hugh Johnson Gentoo Linux Developer & Infra Guy E-Mail : [EMAIL PROTECTED] GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85
pgpFJ0TJHei3I.pgp
Description: PGP signature
