On Mon, Jan 12, 2009 at 23:36, Gunnar Hjalmarsson <nore...@gunnar.cc> wrote:
snip
> I just read Chas's reply, though, and I wasn't aware of the fact that Google
> disallow *all* automated access to their search engine.
snip

Well, they don't disallow all automated access; they do allow
automated access through the SOAP and AJAX interfaces.  There are also
some urls that they do allow bots to look at (see
http://google.com/robots.txt for more info).  And while you can fool
their checks some of the time, if you hit them too hard you will wind
up seeing a page like this

http://sorry.google.com/sorry/?continue=http://www.google.com

or this

http://google.com/sorry/misc/?continue=http://google.com

-- 
Chas. Owens
wonkden.net
The most important skill a programmer can have is the ability to read.

-- 
To unsubscribe, e-mail: beginners-unsubscr...@perl.org
For additional commands, e-mail: beginners-h...@perl.org
http://learn.perl.org/


Reply via email to