bruce [mailto:[EMAIL PROTECTED] wrote: > mark... > > i'm actually faced with a greater issue. i'm looking to > crawl/extract/download the site. simply scraping each site > doesn't get me > the underlying files for the site, in the correct location/names on my > server, to allow me to kind of replicate the basic links of the site.
Aside from the questionable legality of what you're asking, keep in mind that sites using database-backed form-based authentication (as opposed to HTTP Basic Authentication) are often generated via assembly from includes or CMSes or other applications, in which case trying to get the "underlying files" is futile. They may not exist as discrete files on the server. > this requires a crawler... which is what i was originally > looking for/hoping > for, that allows me to deal with the login (user/passwd) form. I have given you the information you need to do this. Simply save the files locally as you crawl them. - Mark. _______________________________________________ Perl-Win32-Users mailing list [email protected] To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
