>>>>> "Bryan" == Bryan Gmyrek <[EMAIL PROTECTED]> writes:
Bryan> What I would like program to do:
Bryan> input: URL
Bryan> actions:
Bryan> 1-download URL and make a list of links
Bryan> 2-make a list of domains that are linked to from the URL
Bryan> 3-delete Page (but output the URL and links to a log file)
Bryan> 4-spider all links from page
Bryan> 5-update list of domains, not replicating ones already listed
Bryan> 6-repeat steps 1 to 5
Bryan> 7-create a table that shows who links to who
Bryan> output:file with link relationships between domains (but not specific
Bryan> pages)
Bryan> Any tips on the different modules I might use and how I might use them
Bryan> would be great.
See WWW::RobotUA, in the CPAN.
--
Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095
<[EMAIL PROTECTED]> <URL:http://www.stonehenge.com/merlyn/>
Perl/Unix/security consulting, Technical writing, Comedy, etc. etc.
See PerlTraining.Stonehenge.com for onsite and open-enrollment Perl training!