Re: Executing js/ajax in a sandboxed environment

2011-02-28 Thread Miki Tebeka
> I was wondering if there is a way to execute js associated in > page in sandbox environment before I start parsing it. You can use http://code.google.com/p/python-spidermonkey/ or http://code.google.com/p/pyv8/ to evaluate JavaScript. You can use any browser (including embedded htmlunit) using

Re: Executing js/ajax in a sandboxed environment

2011-02-27 Thread Amit Sethi
On Sun, Feb 27, 2011 at 10:26 AM, Rohan Malhotra wrote: > BeautifulSoup library only fetches source of page. I need the access > to DOM after js execution with url as input parameter. > > Any pointers? > I am not sure but in case you need to make some ajax requests mechanize might help. http://

Executing js/ajax in a sandboxed environment

2011-02-26 Thread Rohan Malhotra
I need to parse a url for it's content in python. I want to execute all js of html page associated with the url and then parse for the content so that javascript induced changes in content are also present. I was wondering if there is a way to execute js associated in page in sandbox environment be