Found some info here: http://stackoverflow.com/questions/3727662/how-can-you-search-google-programmatically-java-api
Jonathan On Fri, Mar 22, 2013 at 8:32 AM, Cedric Greevey <[email protected]> wrote: > Change your code to it spoofs a common browser user-agent, change your > DHCP-assigned IP address, and try again. They're probably trying to > obstruct bots from making overwhelming numbers of requests or something. As > long as you don't flood them with requests at a higher rate than a human > would generate by clicking, I don't see any ethical issue with > circumventing their countermeasures, especially not if the search will be > triggered by a user input to your application anyway. > > > On Fri, Mar 22, 2013 at 3:09 AM, Rich Morin <[email protected]> wrote: > >> I've been successfully using slurp and laser to harvest and pull >> apart some web pages. However, I can't figure out how to use >> Google Search from my code. >> >> My first thought was to use the Google Search API, but after >> a lot of frustration in trying to get and use an API key, I >> gave up on that. >> >> My next thought was to slurp in a page from the interactive >> Google Search facility, using the URL from Advanced Search: >> >> "http://www.google.com/search?hl=en&as_q=..."; >> >> However, this gives me a 403 nastygram: >> >> IOException Server returned HTTP response code: 403 for URL: >> https://www.google.com/search?hl=en&as_q=&as_epq=... >> sun.net.www.protocol.http.HttpURLConnection.getInputStream >> (HttpURLConnection.java:1436) >> >> Has anyone here, by chance, been able to do this sort of thing? >> >> -r >> >> -- >> http://www.cfcl.com/rdm Rich Morin >> http://www.cfcl.com/rdm/resume [email protected] >> http://www.cfcl.com/rdm/weblog +1 650-873-7841 >> >> Software system design, development, and documentation >> >> >> -- >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to [email protected] >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> [email protected] >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/groups/opt_out. >> >> >> > -- > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to [email protected] > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > [email protected] > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to [email protected] Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
