答复:答复:RE: RE: About lucene memory consumption

2014-07-01 Thread wangzhijiang999
deeMail: u...@thetaphi.de> -Original Message-> From: wangzhijiang999 [mailto:wangzhijiang...@aliyun.com]> Sent: Tuesday, July 01, 2014 9:17 AM> To: java-user> Subject: 答复:RE: RE: About lucene memory consumption> > My application also meet this problem last year and

RE: 答复:RE: RE: About lucene memory consumption

2014-07-01 Thread Uwe Schindler
> -Original Message- > From: wangzhijiang999 [mailto:wangzhijiang...@aliyun.com] > Sent: Tuesday, July 01, 2014 9:17 AM > To: java-user > Subject: 答复:RE: RE: About lucene memory consumption > > My application also meet this problem last year and I researched on the code &

答复:RE: RE: About lucene memory consumption

2014-07-01 Thread wangzhijiang999
My application also meet this problem last year and I researched on the code and found the reason. The whole process is as follow: 1. When using NRTCachingDirectory, it will use RAMDirectory as cache and MMapDirectory as delegate. The new segment will be created in the process of  flush or merge

Re:RE: RE: About lucene memory consumption

2014-06-28 Thread 308181687
"Uwe Schindler";; Date: Sat, Jun 28, 2014 05:41 PM To: "java-user"; Subject: RE: RE: About lucene memory consumption Hi, how does your configuration for NRTCaching directory looks like. There are 2 constructor params, one of the maxMergeSizeMB the other one is maxCac

RE: RE: About lucene memory consumption

2014-06-28 Thread Uwe Schindler
Hi, how does your configuration for NRTCaching directory looks like. There are 2 constructor params, one of the maxMergeSizeMB the other one is maxCachedMB. If you correctly close (or release in case of ReaderManager/SearcherManager) all indexes, this should limit the memory use. There is no

Re:RE: About lucene memory consumption

2014-06-28 Thread 308181687
use ‍MMapDirectory instead of NRTCachingDirectory?‍‍ Thanks & Best Regards! ‍ -- Original -- From: "lubin";<308181...@qq.com>; Date: Sat, Jun 28, 2014 02:03 PM To: "java-user"; Subject: Re:RE: About lucene memory consum

Re:RE: About lucene memory consumption

2014-06-27 Thread 308181687
quot;<308181...@qq.com>; Subject: Re:RE: About lucene memory consumption Could it be that you forgot to close older IndexReaders after getting a new NRT one? This would be a huge memory leak. I recommend to use SearcherManager to handle real time reopen correctly. Uwe Am 27. Juni 2014

Re:RE: About lucene memory consumption

2014-06-27 Thread Uwe Schindler
the >way, we commit the index for every 1000 email document.‍ > > > Could you give me kindly give me some tips to solve this problem? > > > > >Thanks & Best Regards! > > > > > > >‍ > >‍ > >-- Original --

Re:RE: About lucene memory consumption

2014-06-27 Thread 308181687
you give me kindly give me some tips to solve this problem? Thanks & Best Regards! ‍ ‍ -- Original -- From: "Uwe Schindler";; Date: Fri, Jun 27, 2014 08:36 PM To: "java-user"; Subject: RE: About lucene memory consumption

RE: About lucene memory consumption

2014-06-27 Thread Uwe Schindler
age- > From: 308181687 [mailto:308181...@qq.com] > Sent: Friday, June 27, 2014 10:42 AM > To: java-user > Subject: About lucene memory consumption > > Hi, all > > >I fould that the memory consumption of ‍my lucene server is abnormal, and > “jmap -histo ${pid}” show

About lucene memory consumption

2014-06-27 Thread 308181687
Hi, all I fould that the memory consumption of ‍my lucene server is abnormal, and “jmap -histo ${pid}” show that the class of byte[] consume almost all of the memory. Is there memory leak in my app? Why so many byte[] instances? ‍ The following is the top output of jmap:‍ num