Re: preloading / "warming up" the index

2006-05-31 Thread Charles Mi
ache.org Sent: Wednesday, May 31, 2006 11:55:44 PM Subject: Re: preloading / "warming up" the index Thanks for the advice guys... i'm still not entirely clear on what a search causes Lucene to do with respect to warming up/caching portions of the index in memory. If I warm up lucen

Re: preloading / "warming up" the index

2006-05-31 Thread Chris Hostetter
: entry for "apple" ? Basically I'd like to make sure that the entire : inverted index (or as much as possible) is preloaded into memory, so if I if you've got enough ram, and you really want everything loaded into memory, you can allways use a RAMDirectory. even if you want your index stored

Re: preloading / "warming up" the index

2006-05-31 Thread Otis Gospodnetic
/ "warming up" the index Thanks for the advice guys... i'm still not entirely clear on what a search causes Lucene to do with respect to warming up/caching portions of the index in memory. If I warm up lucene using a search for "apple", does Lucene load the entire inverted

Re: preloading / "warming up" the index

2006-05-31 Thread Charles Mi
Thanks for the advice guys... i'm still not entirely clear on what a search causes Lucene to do with respect to warming up/caching portions of the index in memory. If I warm up lucene using a search for "apple", does Lucene load the entire inverted index into Memory, or just the part of the inde

Re: preloading / "warming up" the index

2006-05-31 Thread Cheolgoo Kang
Check this out. http://mail-archives.apache.org/mod_mbox/lucene-java-user/200512.mbox/[EMAIL PROTECTED] On 6/1/06, Monsur Hossain <[EMAIL PROTECTED]> wrote: When Lucene first issues a query, it caches a hash of sort values (one value per document, plus a bit more if you are sorting on strings

Re: preloading / "warming up" the index

2006-05-31 Thread Monsur Hossain
When Lucene first issues a query, it caches a hash of sort values (one value per document, plus a bit more if you are sorting on strings), which takes a while. Therefore, when our application first starts up, we issue one query per sort type. As I understand, it doesn't matter what the query is

preloading / "warming up" the index

2006-05-31 Thread Charles Mi
Is there a way to preload the index into memory when the process starts? Basically I want to warm up the index before processing user queries. What are some recommended ways to do this? Thanks.