disabling all scoring?

2015-02-04 Thread Rob Audenaerde
Hi all, I'm doing some analytics with a custom Collector on a fairly large number of searchresults (+-100.000, all the hits that return from a query). I need to retrieve them by a query (so using search), but I don't need any scoring nor keeping the documents in any order. When profiling the appl

large amount of data cause performance problem

2015-02-04 Thread Heeheeya
hi, i am a fan of lucene.i am recently puzzled by performance problem using lucene while the search result set is large. do you have any advice? as an web application, the exceeding 120 seconds' response time is not acceptable. Looking forward to your reply. thanks so much. 发自我的 iPhone --

performance problem

2015-02-04 Thread 王雅
hi, i am a fan of lucene.i am recently puzzled by performance problem using lucene while the search result set is large. do you have any advice? as an web application, the exceeding 120 seconds' response time is not acceptable. Looking forward to your reply. thanks so much. 发自我的 iPhone

Re: Analyzer: Access to document?

2015-02-04 Thread Ahmet Arslan
Hi Ralf, Does following code fragment work for you? /** * Modified from : http://lucene.apache.org/core/4_10_2/core/org/apache/lucene/analysis/package-summary.html */ public List getAnalyzedTokens(String text) throws IOException { final List list = new ArrayList<>(); try (TokenStream ts = analy

Analyzer: Access to document?

2015-02-04 Thread Ralf Bierig
Hi all, an Analyzer has access to content on a per-field level by overwriting this method: protected TokenStreamComponents createComponents(String fieldName, Reader reader); Is it possible to get to the document? I want to collect the text content from the entire document within my analyze