On Wed, 20 Aug 2008 05:42:34 -0700 (PDT), [EMAIL PROTECTED] wrote: > the web page. When I try to load in a url with the search results, > http://www.google.com/search?hl=en&q=ted', I get a web page that says > I do not have permissions. Is theree a way around this, or is Google > just to smart????
Try to imitate the web browser. Add 'User-Agent' (with add_header method) to your http request. If it won't help, try to add more browser-specific variables to your headers. Also, take a look at mechanize and its Browser class: http://wwwsearch.sourceforge.net/mechanize/ FYI and AFAIK, google doesn't allow to use their search engine in this way. They even block certain IP addresses it it's constantly abusing the search engine with too many requests. -- Regards, Wojtek Walczak, http://tosh.pl/gminick/ -- http://mail.python.org/mailman/listinfo/python-list
