Re: Generic web parser

2009-05-18 Thread S.Selvam
On Mon, May 18, 2009 at 1:59 PM, Jeremiah Dodds wrote: > > > On Sat, May 16, 2009 at 2:18 PM, S.Selvam wrote: > >> Hi all, >> >> I have to design web parser which will visit the given list of websites >> and need to fetch a particular set of details. >> It has to be so generic that even if we add

Re: Generic web parser

2009-05-18 Thread andrew cooke
http://groups.google.com/group/beautifulsoup/browse_thread/thread/d416dd19fdaa43a6 http://jjinux.blogspot.com/2008/10/python-some-notes-on-lxml.html andrew -- http://mail.python.org/mailman/listinfo/python-list

Re: Generic web parser

2009-05-18 Thread Jeremiah Dodds
On Sat, May 16, 2009 at 2:18 PM, S.Selvam wrote: > Hi all, > > I have to design web parser which will visit the given list of websites and > need to fetch a particular set of details. > It has to be so generic that even if we add new websites, it must fetch > those details if available anywhere.

Re: Generic web parser

2009-05-17 Thread James Matthews
I don't see the issue of using urllib and Sqllite for everything you mention here. On Sat, May 16, 2009 at 4:18 PM, S.Selvam wrote: > Hi all, > > I have to design web parser which will visit the given list of websites and > need to fetch a particular set of details. > It has to be so generic tha

Generic web parser

2009-05-16 Thread S.Selvam
Hi all, I have to design web parser which will visit the given list of websites and need to fetch a particular set of details. It has to be so generic that even if we add new websites, it must fetch those details if available anywhere. So it must be something like a framework. Though i have done