Re: Multiple searcher blocked threads

; reduced). > > Also if you are using filters what has really helped us is to use cached > filters (CachingWrapperFilters). > > Hope that helps. > > Yannis. > > On Oct 6, 2010, at 11:12 PM, Shailendra Mudgal wrote: > > > Hi Everyone, > > > > Recently we have

Multiple searcher blocked threads

Hi Everyone, Recently we have migrated from lucene 2.2 to lucene 2.9.3. We are having some issues in search. During the load, searchers are getting hung up. When we took a process stack, we sound that there are around 450 threads are in the blocked state. Thread t...@885: (state = BLOCKED) - o

Re: Document ids collected from HitCollector.collect and used in FieldCache..

che and search will be in synch for that > interval. > > Best > Erick > > On Fri, Apr 18, 2008 at 9:14 AM, Shailendra Mudgal < > [EMAIL PROTECTED]> wrote: > > > Hi Erik Thanks for you prompt reply. > > > > So if i refresh the searcher in every one h

Re: Document ids collected from HitCollector.collect and used in FieldCache..

wrote: > Doc IDs are NOT permanent. If you don't change your index at all > (delete especially, but sometimes adding/optimizing can chage IDs) > then you can re-use them. Otherwise not. > > > On Thu, Apr 17, 2008 at 1:45 PM, Shailendra Mudgal < > [EMAIL PROTECTED]>

how to cache multivalued field using fieldcache.

Hi All, I have a multivalued field in the index. Can i use FieldCache for caching that field. Thanks, Vipin

Document ids collected from HitCollector.collect and used in FieldCache..

Hi All, I have a small confusion regarding the document ids which we collect using HitCollector.collect() method. Here is the description of the confusion : First i created a FieldCache of type > using a query which collects all the articles which are only a month old. I am storing them into a ma

need a better way of caching the value of a field ???

Hi folks, I am using a MultiSearcher object which uses 4 months indexes. I have a requirement for which i need to cache one field for documents which are less then one month old. So for that i am first creating a date query(for last one month) and using HitCollector.collect() for collecting Docume

Re: Improving Index Search Performance

> The bottom line is that reading fields from docs is expensive. > FieldCache will, I believe, load fields for all documents but only > once - so the second and subsequent times it will be fast. Even > without using a cache it is likely that things will speed up because > of caching by the OS. A

Re: Improving Index Search Performance

Hi All, Thanks for your reply. I would like to mention here is that the companyId is a multivalued field. I tried paul's suggestions also but doesn't seem much gain. Still the searcher.doc() method is taking almost the same amount of time. > you can use the FieldCache to lookup the compnayId for

Improving Index Search Performance

Hi Everyone, We are using Lucene to search on a index of around 20G size with around 3 million documents. We are facing performance issues loading large results from the index. Based on the various posts on the forum and documentation, we have made the following code changes to improve the perform

Re: Get the terms and frequency vector of an indexed but unstored field

Hi, If while indexing we have not set this flag, then is there any other way to get this info, i mean the TermFreqVector for a document ?? On 8/3/07, testn <[EMAIL PROTECTED]> wrote: > > > you can use IndexReader.getTermFreqVectors(int n) to get all terms and > their > frequencies. Make sure whe

How to generate TermFreqVector from an existing index

Hi All, I have an index without does not have the termFreqVector stored in it. I do not want to recreate the index as it is a big index and took a lot of time while creation. Is their a other way for generating the termFreqVector with the available info for all the documents. Any help will be app

Re: Caching in lucene

Ok let me explain you. By warming up the reader i used to understand is that it memorizes the index terms. Therefore subsequent queries will be answered by using these terms. Is this correct ? On 9/18/07, Karl Wettin <[EMAIL PROTECTED]> wrote: > > > 18 sep 2007 kl. 08.33 skrev Sh

Re: Caching in lucene

Whether it caches frequently used terms ? On 9/18/07, Karl Wettin <[EMAIL PROTECTED]> wrote: > > > 18 sep 2007 kl. 07.12 skrev Shailendra Mudgal: > > > > > What my goal is to understand the caching strategy. How well this > > work for repetitive queries. Is

Re: Caching in lucene

Hi Yonik, Thanks for your response. I'll feel great if you can explain this in more detail as i am not sure that whether i have understood this correctly or not. Or if you can direct me to some resource that will also be very good for me. What my goal is to understand the caching strategy. How w

Caching in lucene

Hi All, One thing that i understand about IndexReader is that for subsequent queries, results come fast as the IndexReader needs to be warmed up. According to this, I am trying to find out the answers of following questions : - is there any caching is done in lucene for search ? - if yes, is it fo