You are doing fine so far :-) However, urllib is quite low level module. Do you know mechanize http://wwwsearch.sourceforge.net/mechanize/ ? I have used it in my crawler. If you want to crawl a specific site for known data then Scrapy http://scrapy.org/ could be useful too.
David Marek dav...@atrey.karlin.mff.cuni.cz http://davidmarek.cz On Tue, Mar 15, 2011 at 7:10 AM, joy99 <subhakolkata1...@gmail.com> wrote: > Dear Group, > I am trying to construct a web based crawler with Python and for that > I am using the URLLIB module, and by doing > import urllib and then trying with urllib.urlopen("url). > Am I going fine? > If some one can kindly highlight if I am doing any mistake. > Best Regards, > Subhabrata Banerjee. > -- > http://mail.python.org/mailman/listinfo/python-list > -- http://mail.python.org/mailman/listinfo/python-list
