That's interesting.
I've been working in python recently, not crawling though.
But, as ever, the more you get into it the more curious you get.
Did you come up with a solution to a node error?
Are you really talking about a broken link, or are you just saying the
bottom of the tree has been reached
On Wed, Mar 4, 2009 at 4:41 PM, Grant Ingersoll wrote:
> You might have a look at Droids (http://incubator.apache.org/droids/) or
> Nutch (http://lucene.apache.org/nutch) and their communities. They are much
> more focused on crawling (not to say there aren't people here who crawl,
> just saying
You might have a look at Droids (http://incubator.apache.org/droids/)
or Nutch (http://lucene.apache.org/nutch) and their communities. They
are much more focused on crawling (not to say there aren't people here
who crawl, just saying those projects are (mostly) about crawling)
On Mar 4, 2
