On Mar 15, 1:49 pm, David Marek
wrote:
> You are doing fine so far :-)
>
> However, urllib is quite low level module. Do you know
> mechanizehttp://wwwsearch.sourceforge.net/mechanize/? I have used it in my
> crawler. If you want to crawl a specific site for known data then
> Scrapyhttp://scrapy.
You are doing fine so far :-)
However, urllib is quite low level module. Do you know mechanize
http://wwwsearch.sourceforge.net/mechanize/ ? I have used it in my
crawler. If you want to crawl a specific site for known data then
Scrapy http://scrapy.org/ could be useful too.
David Marek
dav...@atr
Well, have you run into any problem, expected or otherwise, yet?
~/santa
On Mon, Mar 14, 2011 at 11:10 PM, joy99 wrote:
> Dear Group,
> I am trying to construct a web based crawler with Python and for that
> I am using the URLLIB module, and by doing
> import urllib and then trying with urlli
Dear Group,
I am trying to construct a web based crawler with Python and for that
I am using the URLLIB module, and by doing
import urllib and then trying with urllib.urlopen("url).
Am I going fine?
If some one can kindly highlight if I am doing any mistake.
Best Regards,
Subhabrata Banerjee.
--
