Re: MultiReader docid reliability

2014-06-02 Thread Nicola Buso
Hi Erick, the good reason for now is caching, we use them to store the results in cache, and I wanted a better explanation of "ephemeral" do understand the possible life of the cache. >From the answers, ephemeral can be related to the opening of the indexreader (in general for precaution) and all

Re: MultiReader docid reliability

2014-05-30 Thread Erick Erickson
If you do an optimize, btw, the internal doc IDs may change. But _why_ do you want to keep them? You may have very good reasons, but it's not clear that this is necessary/desirable from what you've said so far... Best, Erick On Fri, May 30, 2014 at 7:49 AM, Nicola Buso wrote: > Hi, > > th

Re: MultiReader docid reliability

2014-05-30 Thread Nicola Buso
Hi, thanks Michael and Alan. Is enough to know that re-opening the index there is no guarantee that the docids are maintained also if the index does not change. And I will try the question also on the Solr mailinglist. nicola. On Fri, 2014-05-30 at 10:41 -0400, Michael Sokolov wrote: > There

Re: MultiReader docid reliability

2014-05-30 Thread Michael Sokolov
There is a Solr document cache that holds field values too, see: http://wiki.apache.org/solr/SolrCaching Maybe take this question over to the solr mailing list? -Mike On 5/30/2014 10:32 AM, Alan Woodward wrote: Solr caches hold lucene docids, which are invalidated every time a new searcher i

Re: MultiReader docid reliability

2014-05-30 Thread Alan Woodward
Solr caches hold lucene docids, which are invalidated every time a new searcher is opened. The various fields for a response aren't cached as far as I know, they're reloaded on each request. But loading the fields for 10 documents is typically very fast, compared to searching over a very large

Re: MultiReader docid reliability

2014-05-30 Thread Nicola Buso
Hi Alan, just to make it more typical (yes there are not IndexWriters open on that indexes) how solr is caching results? the first thing I would like to do is to store the docs ids and return to the reader for the real content. Is solr storing the whole results with all values? nicola. On Fri,

Re: MultiReader docid reliability

2014-05-30 Thread Alan Woodward
If the index is truly unchanging (ie there's no IndexWriter open on it) then I guess the document numbers will be stable across reopens. But this is a pretty specialized situation, and the docs are really there to warn you off trying to rely on this for more typical uses. Alan Woodward www.fla

Re: MultiReader docid reliability

2014-05-30 Thread Nicola Buso
Hi Alan, thanks a lot for the reply. For what I understood from your reply if the index is not changing (no adds, deletes even updates) the docs id viewed by the MultiReader will not change if you open more times that unchanged index also in different environments. If this is true (my understand

Re: MultiReader docid reliability

2014-05-30 Thread Alan Woodward
Hi Nicola, 1) A session here means as long as you have that MultiReader open. IndexReaders see a snapshot of the index and so document ids shouldn't change over the lifetime of an IndexReader, even if the index is being updated. 2) MultiReader just takes an array of subindexes, so as long as t

MultiReader docid reliability

2014-05-29 Thread Nicola Buso
Hi, from the javadocs: For efficiency, in this API documents are often referred to via document numbers, non-negative integers which each name a unique document in the index. These document numbers are ephemeral -- they may change as documents are added to and deleted from an index. Clients