Hi Steve (Young), Here is my take. It is possible that the web page you are accessing dynamically generates the page using the user-agent.
The user-agent when used from urllib2 will be set to Python-urllib/x.x. If the page were generated dynamically, this would go into the "else" part (of the page-generation logic) and yield a page without all the fancy scripts. Why don't you try setting the user-agent to same as the browser you are using and see if you get the same HTML source this time. Refer http://diveintopython.org/http_web_services/user_agent.html on setting the user-agent. Thanks, --Kartic The Great 'Steve Holden' uttered these words on 2/13/2006 4:53 PM: > Steve Young wrote: > >> Hi, I was wondering why when I use urllib2.build_opener().open(url), >> it doesn't give me the same thing as if I would just click on view--> >> source on my web browser. It gives me most of html on the page but >> leaves out lots of scripts and some of the link's urls are truncated. >> Is there something out there in python that gives me EXACTALLY the >> same thing as if you were to just do view-->source on the web browser? >> Thanks for the help. >> > If this observation is truly correct it should qualify as a bug. Can you > give us a URL and some code which demonstrate your assertion? > > regards > Steve -- http://mail.python.org/mailman/listinfo/python-list
