Re: [BangPypers] Web Page request analysis using Python

2014-07-01 Thread Arun Ravindran
Hi Akshay, It seems that you need to scrape the webpages and execute the JavaScript somehow. There are several solutions to this. A simple approach is to use the Chrome Inspector and copy the URLs being accessed by JavaScript. Another approach will be to use a headless browser like PhantomJS using

[BangPypers] Web Page request analysis using Python

2014-07-01 Thread Akshay Verma
Hi, I am currently using Python 3. I have made a basic program which fetches HTML response from a URL and then parses it to get JS, CSS (using tinyCss2) and Image GET Requests URLs that the page should make to display properly. Problem here is that I am not able to get/locate all the requests as