Re:  OutOfMemoryError throwed by SimpleMergedSegmentWarmer

2014-09-13 Thread 308181687
a FilterAtomicReader subclass to do this. Or, you can disable norms for these fields (e.g. add a single doc that has all these fields w/ norms disabled) and then do a force merge and it will "spread" to the merged segment. Mike McCandless http://blog.mikemccandless.com On Sat, Sep

Re:   OutOfMemoryError throwed by SimpleMergedSegmentWarmer

2014-09-13 Thread 308181687
d, or at least disable norms (takes 1 byte per doc per indexed field regardless of whether that doc had indexed that field), or increase HEAP to the JVM. Mike McCandless http://blog.mikemccandless.com On Sat, Sep 13, 2014 at 4:25 AM, 308181687 <308181...@qq.com> wrote: > Hi, all >we

Re:  OutOfMemoryError throwed by SimpleMergedSegmentWarmer

2014-09-13 Thread 308181687
of whether that doc had indexed that field), or increase HEAP to the JVM. Mike McCandless http://blog.mikemccandless.com On Sat, Sep 13, 2014 at 4:25 AM, 308181687 <308181...@qq.com> wrote: > Hi, all >we got an OutOfMemoryError throwed ‍by SimpleMergedSegmentWarmer. We use &g

OutOfMemoryError throwed by SimpleMergedSegmentWarmer

2014-09-13 Thread 308181687
Hi, all we got an OutOfMemoryError throwed ‍by SimpleMergedSegmentWarmer. We use lucene 4.7, and access index file by NRTCachingDirectory/MMapDirectory. Could any body give me a hand? Strack trace is as follows: org.apache.lucene.index.MergePolicy$MergeException: java.lang.OutOfMemoryEr

Re:RE: 答复:答复:答复:mmap confusion in lucene

2014-07-16 Thread 308181687
artly mapped because the > optimization only starts to kick in after 10,000 method calls (the default > threshold in the JVM).Uwe-Uwe SchindlerH.-H.-Meier-Allee 63, D-28213 > Bremenhttp://www.thetaphi.deeMail: u...@thetaphi.de> -Original > Message-> From: wangzhijiang999 >

Re:答复:mmap confusion in lucene

2014-07-14 Thread 308181687
Hi, Zhiiang It seems that the jvm is smart enough to ignore the unused code. Try the following code: RandomAccessFile raf = new RandomAccessFile(new File("/root/xx.txt"), "r"); FileChannel rafc = raf.getChannel(); ByteBuffer buff = rafc.map(Fi

Re:RE: RE: About lucene memory consumption

2014-06-28 Thread 308181687
Hi, Thank you very much for your reply! After analysis of the heap dump file, i found that there is a RAMFile instance whose size is up to 1,670,583,296. I have limit the maxCachedMB to 60M, why NRTCachingDirectory decide to cache a big file? Obviously this file were produced by me

Re:RE: About lucene memory consumption

2014-06-28 Thread 308181687
"<308181...@qq.com>; Subject: Re:RE: About lucene memory consumption Could it be that you forgot to close older IndexReaders after getting a new NRT one? This would be a huge memory leak. I recommend to use SearcherManager to handle real time reopen correctly. Uwe Am 27. Juni 201

Re:RE: About lucene memory consumption

2014-06-27 Thread 308181687
quot;<308181...@qq.com>; Subject: Re:RE: About lucene memory consumption Could it be that you forgot to close older IndexReaders after getting a new NRT one? This would be a huge memory leak. I recommend to use SearcherManager to handle real time reopen correctly. Uwe Am 27. Juni 2014

Re:RE: About lucene memory consumption

2014-06-27 Thread 308181687
te your index to it (and use MMapDirectory to access it). To help you, give more information on how you use Lucene and its directory implementations. Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message

About lucene memory consumption

2014-06-27 Thread 308181687
Hi, all I fould that the memory consumption of ‍my lucene server is abnormal, and “jmap -histo ${pid}” show that the class of byte[] consume almost all of the memory. Is there memory leak in my app? Why so many byte[] instances? ‍ The following is the top output of jmap:‍ num

??????Why does QueryBuilder.createBooleanQuery create something differentfrom input?

2014-05-13 Thread 308181687
Because of stupid bug in your app. I have tested your code, it work fine: title:?? title:?? title: title:6500 title:?? title: title: title: title:?? title:?? title: title:?? -- -- ??: "Cheng";; : 2014??5??10??(?

Re:Best practice to map Lucene docids to real ids

2014-05-06 Thread 308181687
Why not add an LongField to store the real id, and retrieve it directly by Document.get('real id field name'). lubin -- Original -- From: "Sven Teichmann";; Date: Tue, May 6, 2014 04:33 PM To: "java-user"; Subject: Best practice to map Lucene docids to re

?????? Never close IndexWriter/Reader?

2014-05-03 Thread 308181687
Hi, Mike. Instead of periodically reopen NRT reader , I open/close it for every search query , will this result in performance issue? Thanks lubin -- -- ??: "Michael McCandless";; : 2014??5??4??(??) 1:43 ??: "Lucene Users";