Re: Open source web crawler with mysql integration

On Apr 9, 7:37 pm, Daniel Fetchinson wrote: > Have a look athttp://nikitathespider.com/python/ Thanks, I'll have a look. -- http://mail.python.org/mailman/listinfo/python-list

Open source web crawler with mysql integration

I'm looking for a crawler that can spider my site and toss the results into mysql so, in turn, that database can be indexed by Sphinx Search. Since I don't want to reinvent the wheel, is anyone aware of any open source projects or code snippets that can already handle this? Thanks for any advice.