> I maintain anu.homelinux.net and werc.homelinux.net sites, mine > robots.txt files are quite simple and I never ever facing these servers > being chocked by any such bot.
i think it's a mistake to generalized from a sample size of 1 or 2 to the whole world. give 'em a break. - erik
