OK, thanks. :-) Glen
2009/9/14 Anthony Urso <anthony.u...@gmail.com>: > It's best to file a feature request on the Lucene issue tracker if you > are interested in seeing this implemented. > > http://issues.apache.org/jira/browse/LUCENE > > Just cut and paste your description and attach a patch and/or tests if > you have them. > > Cheers, > Anthony > > On Mon, Sep 14, 2009 at 1:03 PM, Glen Newton <glen.new...@gmail.com> wrote: >> Hi, >> >> In 2.4.1, Field has 2 constructors that involve a Reader: >> public Field(String name, >> Reader reader) >> public Field(String name, >> Reader reader, >> Field.TermVector termVector) >> >> http://lucene.apache.org/java/2_4_1/api/core/org/apache/lucene/document/Field.html#Field(java.lang.String,%20java.io.Reader,%20org.apache.lucene.document.Field.TermVector) >> >> The Reader references a text file on the filesystem. These >> constructors do the following: >> "Create a tokenized and indexed field that is not stored, optionally >> with storing term vectors. The Reader is read only when the Document >> is added to the index, i.e. you may not close the Reader until >> IndexWriter.addDocument(Document) has been called." >> >> Someone has made the decision that we will not be interested in >> storing files read using a Reader (at least not with these >> constructors). >> This is rather arbitrary. >> As someone who has massively parralelized my indexing AND sometimes >> might want to also store files in the index, having a queue of 1000 >> Documents with 1000 Readers to files is vastly preferable to having >> 1000 documents with 1000 (perhaps very large) Strings with all the >> contents of the files. While this is not the best for all cases (#open >> file handles, etc), this is a use case which would benefit from being >> able to do this (i.e. reduced memory footprint, especially for large >> files or large queues). >> >> Suggestion: replace or add a constructor with: >> public Field(String name, >> Reader reader, >> Field.Store store, >> Field.Index index, >> Field.TermVector termVector) >> >> Constructively, >> >> Glen Newton >> http://zzzoot.blogspot.com/ >> http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql >> >> - >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> For additional commands, e-mail: java-user-h...@lucene.apache.org >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > -- - --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
