Re: download web pages that are updated by ajax

2011-04-12 Thread Jabba Laci
> I've heard you can drive a web browser using Selenium > (http://code.google.com/p/selenium/ ), have it visit the webpage and > run the JavaScript on it, and then grab the final result. Hi, Thanks for the info. I tried selenium, you can get the source with the get_html_source() function but it r

Re: download web pages that are updated by ajax

2011-04-12 Thread Chris Rebert
On Tue, Apr 12, 2011 at 7:47 AM, Jabba Laci wrote: > Hi, > > I want to download a web page that is updated by AJAX. The page > requires no human interaction, it is updated automatically: > http://www.ncbi.nlm.nih.gov/nuccore/CP002059.1 > > If I download it with wget, I get a file of size 97 KB. Th

download web pages that are updated by ajax

2011-04-12 Thread Jabba Laci
Hi, I want to download a web page that is updated by AJAX. The page requires no human interaction, it is updated automatically: http://www.ncbi.nlm.nih.gov/nuccore/CP002059.1 If I download it with wget, I get a file of size 97 KB. The source is full of AJAX calls, i.e. the content of the page is