Re: salutations and web scraping

2013-01-30 Thread Catonano
2013/1/7 Andy Wingo > I know it's a year late, but I tracked this one down > Anyway, fetching friendfeed.com/ > now works properly. > > Thank you, Andy ;-)

Re: salutations and web scraping

2013-01-07 Thread Andy Wingo
On Fri 27 Jan 2012 13:18, Catonano writes: > So it seems to me that this workaround of indicating a http 1.0 request > introduces too much unpredictability from the servers; I'm probably > running in a not so common case so some shoddiness in servers > configurations is emerging I know it's a ye

Re: salutations and web scraping

2012-01-29 Thread Catonano
Andy, Il giorno 25 gennaio 2012 09:57, Andy Wingo ha scritto: > There is no workaround in the source, no. > > Ian Price has a workaround: > > https://lists.gnu.org/archive/html/guile-user/2011-11/msg00011.html > > We need to get that into Guile. > Should I want to try to follow this issue and

Re: salutations and web scraping

2012-01-27 Thread Catonano
I have some updates about this issue, should anyone be interested. Il giorno 25 gennaio 2012 18:23, Catonano ha scritto: > > > Il giorno 25 gennaio 2012 10:07, Andy Wingo ha scritto: > >> On Wed 25 Jan 2012 04:56, Daniel Hartwig writes: >> >> > (http-get uri #:version '(1 . 0) ...) >> >> Good

Re: salutations and web scraping

2012-01-25 Thread Catonano
Il giorno 25 gennaio 2012 10:07, Andy Wingo ha scritto: > On Wed 25 Jan 2012 04:56, Daniel Hartwig writes: > > > (http-get uri #:version '(1 . 0) ...) > > Good point! > yes, good point. I tried, it works. Thanks. This could have been a show stopper to me.

Re: salutations and web scraping

2012-01-25 Thread Andy Wingo
On Wed 25 Jan 2012 04:56, Daniel Hartwig writes: > Chunked encoding was introduced in HTTP 1.1 so you can try using 1.0 > for your request: > > (http-get uri #:version '(1 . 0) ...) Good point! Andy -- http://wingolog.org/

Re: salutations and web scraping

2012-01-25 Thread Andy Wingo
On Wed 25 Jan 2012 02:41, Catonano writes: > It happens that the response I get from the server of the radio > station is chuncked (that is (transfer-encoding (chuncked))   ) > > so when I issue the (htt-get uri) instrucion I get > > $2 = #< etc. > $3 = #f > > that is no page source > > Is there

Re: salutations and web scraping

2012-01-24 Thread Catonano
Daniel, Il giorno 25 gennaio 2012 04:56, Daniel Hartwig ha scritto: > Hi there > thank you for your suggestions. I'll try with them Otherwise, Ian Price recently posted a patch adding support for > chunked encoding which you might like to try: > > http://thread.gmane.org/gmane.lisp.guile.user/

Re: salutations and web scraping

2012-01-24 Thread Daniel Hartwig
Hi there On 25 January 2012 09:41, Catonano wrote: > > It happens that the response I get from the server of the radio station is > chuncked (that is (transfer-encoding (chuncked))   ) > > so when I issue the (htt-get uri) instrucion I get > > $2 = #< etc. > $3 = #f > > that is no page source > >

Re: salutations and web scraping

2012-01-24 Thread Catonano
Il giorno 24 gennaio 2012 15:17, Catonano haI´ll let you kow how I´m gonna proceed with this idea so here I am to let you know. It happens that the response I get from the server of the radio station is chuncked (that is (transfer-encoding (chuncked)) ) so when I issue the (htt-get uri) instr

Re: salutations and web scraping

2012-01-24 Thread Catonano
Andy, again, thank you so much. Il giorno 24 gennaio 2012 14:07, Andy Wingo ha scritto: > In this case, try checking the response-code, and if it's a redirect > code, then look at the response-location. See response-location in the > manual. > > yes, it was a simple redirect from www.friendfee

Re: salutations and web scraping

2012-01-24 Thread Andy Wingo
On Tue 24 Jan 2012 13:47, Catonano writes: > I tried with www.friendfeed.com and I got back what follows: > >  $11 = "\r > 301 Moved Permanently\r > \r > 301 Moved Permanently\r > nginx/0.6.31\r > \r > \r > " I suspect here in $10 you got a response with the response-code of 301. It's a redirect

Re: salutations and web scraping

2012-01-24 Thread Catonano
Andy, I´m back onto this thing. I´ll never thank you enough, your suggestions were helpful and insightful. Now, I think I have to signal a potential problem Il giorno 10 gennaio 2012 22:46, Andy Wingo ha scritto: > > (use-modules (web client) (web uri)) > > (http-get (string->uri "http://www

Re: salutations and web scraping

2012-01-16 Thread Catonano
Andy, Il giorno 10 gennaio 2012 22:46, Andy Wingo ha scritto: > Hi Catonano, > > On Fri 30 Dec 2011 23:58, Catonano writes: > > > I´m a beginner, I never wrote a single line of LISP or Scheme in my life > > and I´m here for asking for directions and suggestions. > > Welcome! :-) > thank you so

Re: salutations and web scraping

2012-01-10 Thread Andy Wingo
Hi Catonano, On Fri 30 Dec 2011 23:58, Catonano writes: > I´m a beginner, I never wrote a single line of LISP or Scheme in my life > and I´m here for asking for directions and suggestions. Welcome! :-) > I´m mumbling about a pet project. I would like to scrape the web site of > a comunitarian

salutations and web scraping

2011-12-30 Thread Catonano
Hello people, Happy New Year. I´m a beginner, I never wrote a single line of LISP or Scheme in my life and I´m here for asking for directions and suggestions. I´m mumbling about a pet project. I would like to scrape the web site of a comunitarian radio station and grab the flash streamed content