Re: scraping with urllib2

2010-01-27 Thread Javier Collado
Hello, To accept cookies, use the HTTPCookieProcessor as explained here: http://www.nomadjourney.com/2009/03/automatic-site-login-using-python-urllib2/ Best regards, Javier 2010/1/27 Andre Engels : > On Wed, Jan 27, 2010 at 6:26 AM, Patrick wrote: >> I'm trying to scrape the attached link f

Re: scraping with urllib2

2010-01-26 Thread Andre Engels
On Wed, Jan 27, 2010 at 6:26 AM, Patrick wrote: > I'm trying to scrape the attached link for the price listed $99.99: > http://bananarepublic.gap.com/browse/product.do?cid=41559&vid=1&pid=692392 > > I can see the price if I view the source(I even turned off java and > javascript), but when I use u

scraping with urllib2

2010-01-26 Thread Patrick
I'm trying to scrape the attached link for the price listed $99.99: http://bananarepublic.gap.com/browse/product.do?cid=41559&vid=1&pid=692392 I can see the price if I view the source(I even turned off java and javascript), but when I use urllib2, the price doesn't show up. Is there another libra