Re: Help pulling data from website

2011-10-26 Thread John SJ Anderson
Seriously, last warning. Thread is over. Let it go, guys; go for a walk or something. thanks, john, aka your list mom. -- To unsubscribe, e-mail: beginners-unsubscr...@perl.org For additional commands, e-mail: beginners-h...@perl.org http://learn.perl.org/

Re: Help pulling data from website

2011-10-26 Thread Shawn H Corey
On 11-10-26 03:22 PM, Randal L. Schwartz wrote: If that's not available, I'd frown on any second step, unless the answer is "go ahead and scrape it from our fully-composed web pages". Facts cannot be copyrighted. The prices they offer their goods at are facts. Only creative works can be copyri

Re: Help pulling data from website

2011-10-26 Thread Randal L. Schwartz
> "Jeswin" == Jeswin writes: Jeswin> I want to pull price data from a website and would like your advice on Jeswin> getting started. First step: ask the site owner for a data feed. If that's not available, I'd frown on any second step, unless the answer is "go ahead and scrape it from our

Re: Help pulling data from website

2011-10-26 Thread John SJ Anderson
How about we don't have this particular fight again on this list, okay? The original question has been answered from both the "completely correct, future proof, Do It Right" crowd and the "pragmatic, works good enough, 80% is better than nothing" crowd. Unless the original poster needs clarif

Re: Help pulling data from website

2011-10-26 Thread Shawn H Corey
On 11-10-26 11:00 AM, Paul Johnson wrote: Yeah, yeah, yeah. Using the argument that regular expressions can't parse HTML because HTML isn't regular is fine. Until you realise that Perl's regular expressions, along with those of pretty much every other language or library, aren't actually regula

Re: Help pulling data from website

2011-10-26 Thread Paul Johnson
On Wed, Oct 26, 2011 at 03:22:24PM +0200, Shlomi Fish wrote: > Hi Jeswin, > > On Wed, 26 Oct 2011 09:04:32 -0400 > Jeswin wrote: > > > Hi all, > > I'm still a beginner but I have a project I want to work on. > > > > I want to pull price data from a website and would like your advice on > > gett

Re: Help pulling data from website

2011-10-26 Thread Shawn H Corey
On 11-10-26 09:22 AM, Shlomi Fish wrote: First of all, you should be using WWW::Mechanize or something similar to perform the web-automation. Then you should use XML::LibXML's HTML parsing mode or HTML::TreeBuilder or similar to retrieve the data from the HTML. Do *not* parse HTML using regular

Re: Help pulling data from website

2011-10-26 Thread Shlomi Fish
Hi Jeswin, On Wed, 26 Oct 2011 09:04:32 -0400 Jeswin wrote: > Hi all, > I'm still a beginner but I have a project I want to work on. > > I want to pull price data from a website and would like your advice on > getting started. > > This is my idea and a basic implementation of the process: > >

Help pulling data from website

2011-10-26 Thread Jeswin
Hi all, I'm still a beginner but I have a project I want to work on. I want to pull price data from a website and would like your advice on getting started. This is my idea and a basic implementation of the process: 1) The input is coverted to the web link, i.e., if I type in "force of will" the