Thanks Rob...
Joseph,
I am trying to scrape a website for which I have
paid to look at the data. However since it is
currently time consuming, I like to parse the data
using perl to present it in a condensed form for my
personal use. None of the data will be published and
so I assume I do not
No extra module is needed. WWW::Mechanize is a subclass of LWP::UserAgent,
which supports it.
my $ua = new WWW::Mechanize();
$ua->credentials('www.myhostname.com:80', 'RealmName', 'user', 'pass');
$ua->get('http://www.myhostname.com');
print $ua->content;
The params are host/port, realm, userna
Raghupathy wrote:
> Hi,
>
> I like to use WWW::Mechanize to scrape a website.
> However the website has a authentication page. Is
> there a perl module I can use to perform the
> authentication ?
>
> Thanks,
> Raghu
Do you have the authors permission to scrape? It is possible that
they want to
