Re: Regarding multiple index creation and Searching

2011-08-17 Thread Mihai Caraman
heard that ~80million docs per index (varying with average document size). @Uwe Schindler: Is hashed distribution really necessary when using MultiReader? I did hear that solr uses continuous hashing algorithm with shards of indexes. But MultiReader didn't say anything about hashing.

RE: Regarding multiple index creation and Searching

2011-08-15 Thread Uwe Schindler
Hi, This all depends on your index contents and hardware. In general the size of a single index / index segment vs multiple segments / indexes is not an issue on one single machine. To scale, you should also think of using more than one machine with e.g. ElasticSearch or Apache Solr instead of pla

Regarding multiple index creation and Searching

2011-08-15 Thread Saurabh Gokhale
Hi All, In my application, we have been maintaining lucene index for the 3 years worth of data. (more than 70GB of single lucene index). To improve performance, recently it was decided to break indexes into 1 year worth of data each (3 indexes). before we work on the required change, I wanted to g