Re: Urllib's urlopen and urlretrieve

2013-02-22 Thread MRAB
[snip] > As for which version if Python, I have been using Python 2 to learn on > as I heard that Python 3 was still largely unadopted due to a lack of > library support etc... by comparison. Are people adopting it fast > enough now that I should consider learning on 3 instead of 2? > [snip] You s

Re: Urllib's urlopen and urlretrieve

2013-02-22 Thread Dave Angel
On 02/22/2013 12:09 AM, qoresu...@gmail.com wrote: Initially I was just trying the html, but later when I attempted more complicated sites that weren't my own I noticed that large bulks of the site were lost in the process. The urllib code essentially looks like what I was trying but it didn't

Re: Urllib's urlopen and urlretrieve

2013-02-21 Thread qoresucks
Initially I was just trying the html, but later when I attempted more complicated sites that weren't my own I noticed that large bulks of the site were lost in the process. The urllib code essentially looks like what I was trying but it didn't work as I had expected. To be more specific, after

Re: Urllib's urlopen and urlretrieve

2013-02-21 Thread Dave Angel
On 02/21/2013 07:12 AM, qoresu...@gmail.com wrote: Why is it that when using urllib.urlopen then reading or urllib.urlretrieve, does it only give me parts of the sites, loosing the formatting, images, etc...? How can I get around this? Start by telling us if you're using Python2 or Python

Re: Urllib's urlopen and urlretrieve

2013-02-21 Thread Dave Angel
On 02/21/2013 12:47 PM, rh wrote: On Thu, 21 Feb 2013 10:56:15 -0500 Dave Angel wrote: On 02/21/2013 07:12 AM, qoresu...@gmail.com wrote: I only just started Python and given that I know nothing about network programming or internet programming of any kind really, I thought it would be interes

Re: Urllib's urlopen and urlretrieve

2013-02-21 Thread Dave Angel
On 02/21/2013 07:12 AM, qoresu...@gmail.com wrote: I only just started Python and given that I know nothing about network programming or internet programming of any kind really, I thought it would be interesting to try write something that could create an archive of a website for myself. Ple

Re: Urllib's urlopen and urlretrieve

2013-02-21 Thread Michael Herman
Are you just trying to get the html? If so, you can use this code- *import urllib* * * *# fetch the and download a webpage, nameing it test.html* *urllib.urlretrieve("http://www.web2py.com/";, filename="test.html")* I recommend using the requests library, as it's easier to use and more powerful: