Re: Storing an ID alongside a document

2011-02-02 Thread Yonik Seeley
On Wed, Feb 2, 2011 at 9:23 PM, Jason Rutherglen wrote: > Is it? I thought it would load the values into heap RAM like the > field cache and in addition save the values to disk? Does it also > read the values directly from disk? > Loading into memory is a separate optional part (i.e. loading a

Re: Storing an ID alongside a document

2011-02-02 Thread Jason Rutherglen
Is it? I thought it would load the values into heap RAM like the field cache and in addition save the values to disk? Does it also read the values directly from disk? On Wed, Feb 2, 2011 at 2:00 PM, Yonik Seeley wrote: > That's exactly what the CSF feature is for, right?  (docvalues branch) > >

Re: Payloads API and support

2011-02-02 Thread Ophir Cohen
Hi Grant, Thanks for the answer - it wasn't a question of patient just accidentally sent the same message more than once... Sorry for that. Anyway, I'm checking right now the option to hold the metrics in in-memory array (for all docs) and retrieve the metrics for that array rather than from Lucen

Re: Storing an ID alongside a document

2011-02-02 Thread Yonik Seeley
That's exactly what the CSF feature is for, right? (docvalues branch) -Yonik http://lucidimagination.com On Wed, Feb 2, 2011 at 1:03 PM, Jason Rutherglen wrote: > I'm curious if there's a new way (using flex or term states) to store > IDs alongside a document and retrieve the IDs of the top N

Re: Storing payloads without term-position and frequency

2011-02-02 Thread Yuhan Zhang
HI Alex, you can specify the infomation to be stored on a field by setting Field.TermVector.NO doc.add(new Field(TEXT_FIELD_NAME, text, Field.Store.NO, Field.Index.ANALYZED, Field.TermVector.NO)); On Wed, Feb 2, 2011 at 11:35 AM, Alex vB wrote: > > Hello everybody, > > I am currently using Luc

Storing payloads without term-position and frequency

2011-02-02 Thread Alex vB
Hello everybody, I am currently using Lucene 3.0.2 with payloads. I store extra information in the payloads about the term like frequencies and therefore I don't need frequencies and term positions stored normally by Lucene. I would like to set f.setOmitTermFreqAndPositions(true) but then I am no

Storing an ID alongside a document

2011-02-02 Thread Jason Rutherglen
I'm curious if there's a new way (using flex or term states) to store IDs alongside a document and retrieve the IDs of the top N results? The goal would be to minimize HD seeks, and not use field caches (because they consume too much heap space) or the doc stores (which require two seeks). One pos

Re: Payloads API and support

2011-02-02 Thread Grant Ingersoll
On Feb 1, 2011, at 2:59 AM, Ophir Cohen wrote: > Hi Guys, > > I've been using Lucene for more than 5 years and it is a great tool - great > job! Thanks for everything... Thanks. Just so you know going forward, please be patient in expecting answers, especially for complex questions like this