RE: obtain web page contents with perl through a proxy server

2003-08-08 Thread wiggins


On Wed, 6 Aug 2003 21:07:50 -0700 (PDT), wendy soros <[EMAIL PROTECTED]> wrote:

> Hi,
> 
> I am a new perl user. I have a question of obtaining
> web page contents with perl. Hope you can help me.
> 
> Here is my question: how can I use perl to access a
> webpage, fill in some search parameters, pull out
> parts of the search results returned that I really
> need and save them in a file? 
> 
> For example, a web site has some information about a
> bunch of companies for various years. After one puts
> in the company name and the relevant years, one would
> be directed to another page that has the text contents
> needed. 
> 
> I have the file containing the company names and the
> years I want. Since the number of companies I have is
> large, it would be really nice to have perl pull out
> the contents for me. Could it do this? How? What if I
> need to access the web page through a proxy server? 
> 
> Once again, I am new to the perl community and I am
> sorry if the question is too simple. But I do need you
> help. Thanks a lot.
> 

"No job is to small, no fee is to small!" -Ghostbusters

You should check out the LWP set of modules from CPAN. It makes this kind of task 
bearable and should provide all of the functionality you need. 

http://search.cpan.org/author/GAAS/libwww-perl-5.69/lib/LWP.pm

In particular you may want to start with the lwp-cook documentation as it provides 
good working examples.  Have a read through the docs, give it a stab and come back 
with questions when you get stuck...

http://danconia.org

-- 
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



beginners-cgi@perl.org

2003-08-08 Thread Kristofer Hoch
Marcus,
  You are going to have to URL escape it.  Review URI::Escape...
http://theoryx5.uwinnipeg.ca/CPAN/data/URI/URI/Escape.html

Thanks,
Kristofer

=
-BEGIN GEEK CODE BLOCK-
Version: 3.12
GIT d s+:++ a C++ UL++ US+ P+++ L++ 
W+++ w PS PE t++ b+ G e r+++ z
--END GEEK CODE BLOCK--

__
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
http://sitebuilder.yahoo.com

-- 
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: Summary: obtain web page contents with perl through proxy server

2003-08-08 Thread zentara
On Fri, 8 Aug 2003 00:09:26 -0700 (PDT), [EMAIL PROTECTED] (Wendy Soros)
wrote:

>Hi,
>
>Thanks to Awarsd, Wiggins, and Patricia for your quick
>replies. As all of you suggest,
>I will have a look at the LWP module first. I guess I
>will trouble you guys/girls again when
>I find problems learning the LWP module. 

Try this:
http://perlmonks.org/index.pl?node=lwp+proxy&go_button=Search



-- 
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]