Re: deleteDocument with NRT

2014-07-10 Thread Tri Cao
You need to reopen your searcher after deleting. From Java doc for SearcherManager: In addition you should periodically call maybeRefresh. While it's possible to call this just before running each query, this is discouraged since it penalizes the unlucky queries that do the reopen. It's better

Re: How to handle words that stem to stop words

2014-07-10 Thread Arjen van der Meijden
Hi Sujit, Thanks. I was thinking along those lines myself. And reversely, the same list of stopwords could be used to mark the stopwords as keyword as well, to prevent them from collapsing with rare words. Best regards, Arjen On 10-7-2014 22:30 Sujit Pal wrote: Hi Arjen, This is kind of a

deleteDocument with NRT

2014-07-10 Thread Jamie
Hi I am using NRT search with the SearcherManager class. When the user elects to delete some documents, writer.deleteDocuments(terms) is called. The problem is that deletes are not immediately visible. What does it take to make them so? Even after calling commit(), the deleted documents are

Re: How to handle words that stem to stop words

2014-07-10 Thread Sujit Pal
Hi Arjen, This is kind of a spin on your last observation that your list of stop words don't change frequently. If you have a custom filter that attempts to stem the incoming token and if it stems to the same as a stopword, only then sets the keyword attribute on the original token. That way your

Re: How to handle words that stem to stop words

2014-07-10 Thread Arjen van der Meijden
I'm reluctant to apply either solution: Emitting both tokens will likely still provide the user with a very long result list. Even though the results with 'vans' in it are likely to be ranked to the top, its still not very user friendly due to its overwhelmingly large number of results (nor is

Re: Lucene 4.0 tokenstream logic

2014-07-10 Thread Falakh TE
Hi, I have the same problem for(String str2:split) { TokenStream stream = analyzer.tokenStream("field", new StringReader(str2)); CharTermAttribute termAtt =

Re: Sort, Search & Facets

2014-07-10 Thread Shai Erera
Hi Currently we do not provide the means to use a single SortedSetDVField for both faceting and sorting. You can add a SortedSetDVFacetField to a Document, then use FacetsConfig.build(), but that encodes all your dimensions under a single SSDV field. It's done for efficiency, since at search time,

Re: IndexSearcher.doc thread safe problem

2014-07-10 Thread sunmoo, KIM
This problem is solved. Queue is OK in multi-thread. Lucene searcher is OK in multi-thread. Hoss as saying the problem was found while demonstrate testing. My method had the problem. Thanks to helpers. 2014-07-10 11:05 GMT+09:00 Chris Hostetter : > > : 4. Syncronized searcher.doc method call