Re: web crawler

2012-12-16 Thread Shlomi Fish
Hi Aravind, On Sat, 15 Dec 2012 17:54:23 +0100 venkates wrote: > Hi, > > I am trying to write a minimal web crawler. The aim is to discover new > URLs from the seed and crawl these new URLs further. The code is as follows: > > use strict; > use warnings; > use Car

web crawler

2012-12-15 Thread venkates
Hi, I am trying to write a minimal web crawler. The aim is to discover new URLs from the seed and crawl these new URLs further. The code is as follows: use strict; use warnings; use Carp; use Data::Dumper; use WWW::Mechanize; my $url = "http://foobar.com";; # example my %links;