Brian,
Thanks for your response.
The following module was proposed for inclusion in the Module List:
modid: LWP::Description
DSLIP: idpOg
description: Get the description of a web page
userid: NHORNE (Nigel Horne)
chapterid: 15 (World_Wide_Web_HTML_HTTP_CGI)
communities:
similar:
rationale:
I thought I'd seen a CPAN module to do this already, but I must
have been wrong.
Were you thinking of HTML::HeadParser for instance?
I think LWP is the wrong place to put this since LWP deals with many
things that aren't HTML. How about HTML::Description if
HTML::HeadParser doesn't do what you want?
I've put a lot of work into minimizing traffic into my POC code, for
example with the use of if-modified-since and caching none of which
would be relevant in an HTML:: module.
Regards,
-Nigel