Re: Open source web crawler with mysql integration

2009-04-10 Thread Daniel Fetchinson
On 4/10/09, Philip Semanchuk wrote: > > On Apr 10, 2009, at 10:37 PM, Lawrence D'Oliveiro wrote: > >> In message , >> Philip >> Semanchuk wrote: >> >>> I'd love to open source it and if someone wants to pay me to make >>> it open >>> source-able, let's talk! >> >> Nobody's going to pay you for som

Re: Open source web crawler with mysql integration

2009-04-10 Thread Philip Semanchuk
On Apr 10, 2009, at 10:37 PM, Lawrence D'Oliveiro wrote: In message , Philip Semanchuk wrote: I'd love to open source it and if someone wants to pay me to make it open source-able, let's talk! Nobody's going to pay you for something of doubtful value--it's up to you to prove the valu

Re: Open source web crawler with mysql integration

2009-04-10 Thread Lawrence D'Oliveiro
In message , Philip Semanchuk wrote: > I'd love to open source it and if someone wants to pay me to make it open > source-able, let's talk! Nobody's going to pay you for something of doubtful value--it's up to you to prove the value of the code first. You must go to the community, the communit

Re: Open source web crawler with mysql integration

2009-04-10 Thread Philip Semanchuk
y, April 10, 2009 8:10 AM To: Python (General) Subject: Re: Open source web crawler with mysql integration On Apr 10, 2009, at 10:28 AM, Support Desk wrote: Sounds Interesting. When its done would you care to share it? Hi Michael, The coding has been done (as much as software is ever "

RE: Open source web crawler with mysql integration

2009-04-10 Thread bruce
though I hope not) before I can make the time. Regards Philip > -Original Message- > From: Philip Semanchuk [mailto:phi...@semanchuk.com] > Sent: Thursday, April 09, 2009 9:46 PM > To: Python > Subject: Re: Open source web crawler with mysql integration > > > On Apr 9, 2009, at 7:3

Re: Open source web crawler with mysql integration

2009-04-10 Thread Philip Semanchuk
-Original Message- From: Philip Semanchuk [mailto:phi...@semanchuk.com] Sent: Thursday, April 09, 2009 9:46 PM To: Python Subject: Re: Open source web crawler with mysql integration On Apr 9, 2009, at 7:37 PM, Daniel Fetchinson wrote: I'm looking for a crawler that can spider my

RE: Open source web crawler with mysql integration

2009-04-10 Thread Support Desk
Sounds Interesting. When its done would you care to share it? Sincerely, Michael H. -Original Message- From: Philip Semanchuk [mailto:phi...@semanchuk.com] Sent: Thursday, April 09, 2009 9:46 PM To: Python Subject: Re: Open source web crawler with mysql integration On Apr 9, 2009, at

Re: Open source web crawler with mysql integration

2009-04-09 Thread Philip Semanchuk
On Apr 9, 2009, at 7:37 PM, Daniel Fetchinson wrote: I'm looking for a crawler that can spider my site and toss the results into mysql so, in turn, that database can be indexed by Sphinx Search. Since I don't want to reinvent the wheel, is anyone aware of any open source projects or code s

Re: Open source web crawler with mysql integration

2009-04-09 Thread dhenews
On Apr 9, 7:37 pm, Daniel Fetchinson wrote: > Have a look athttp://nikitathespider.com/python/ Thanks, I'll have a look. -- http://mail.python.org/mailman/listinfo/python-list

Re: Open source web crawler with mysql integration

2009-04-09 Thread Daniel Fetchinson
> I'm looking for a crawler that can spider my site and toss the results > into mysql so, in turn, that database can be indexed by Sphinx Search. > > Since I don't want to reinvent the wheel, is anyone aware of any open > source projects or code snippets that can already handle this? Have a look a