Re: A way to download URLs and index better ?

2010-01-16 Thread Phan The Dai
Thank much to Ahmet Arslan, Although I have known about Nutch and Heritrix, when I read Lucene in Action book but I am a newer of using them I am not sure they are support for my situation. I need an API allowing my application automatically fetching URLs and download them into a Directory (as Dir

Re: A way to download URLs and index better ?

2010-01-16 Thread Otis Gospodnetic
Hello, Use Droids, it's much simpler than Nutch or Heritrix: http://incubator.apache.org/droids/ Otis -- Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch - Original Message > From: Phan The Dai > To: java-user@lucene.apache.org > Sent: Sat, January 16, 2010 2:20:47 AM > Sub