Re: IndexDivisor

2009-12-08 Thread Michael McCandless
> > > - Original Message - > From: "Michael McCandless" > To: > Sent: Sunday, December 06, 2009 3:14 PM > Subject: Re: IndexDivisor > > > You really have to use a profiler, to trust the RAM measurements. > > Certain queries, eg function queri

Re: IndexDivisor

2009-12-08 Thread Ganesh
6, 2009 3:14 PM Subject: Re: IndexDivisor You really have to use a profiler, to trust the RAM measurements. Certain queries, eg function queries, can load the field cache. What kind of queries are you running? Mike On Fri, Dec 4, 2009 at 9:11 AM, Ganesh wrote: > I didn't run with pro

Re: IndexDivisor

2009-12-06 Thread Michael McCandless
ry.  There is > no deletions, no norms and i am not doing sorting > > Regards > Ganesh > > > - Original Message - > From: "Michael McCandless" > To: > Sent: Friday, December 04, 2009 7:01 PM > Subject: Re: IndexDivisor > > > I'm

Re: IndexDivisor

2009-12-04 Thread Ganesh
mes memory. There is no deletions, no norms and i am not doing sorting Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Friday, December 04, 2009 7:01 PM Subject: Re: IndexDivisor I'm confused -- what are these attachments? Output from a memor

Re: IndexDivisor

2009-12-04 Thread Michael McCandless
doing sorting. > > Regards > Ganesh > > > > - Original Message - > From: "Michael McCandless" > To: > Sent: Thursday, December 03, 2009 9:35 PM > Subject: Re: IndexDivisor > > > Can you run w/ a memory profiler?  I don't trust that gc

Re: IndexDivisor

2009-12-03 Thread Ganesh
close all the searcher and reader. There is no deletions, no norms and i am not doing sorting. Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Thursday, December 03, 2009 9:35 PM Subject: Re: IndexDivisor Can you run w/ a memory profiler? I d

Re: IndexDivisor

2009-12-03 Thread Benjamin Heilbrunn
Maybe the command line argument "-verbose:gc output" would help to determine if GC is running. But you are right - a profiler would be the best way. Benjamin - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For a

Re: IndexDivisor

2009-12-03 Thread Michael McCandless
 IndexDivisor Memory >  -1         7 MB >  1         486 MB >  100     180 MB >  1000     176 MB. > 1    176MB > > Regards > Ganesh > > - Original Message - > From: "Danil ŢORIN" > To: > Sent: Thursday, December 03, 2009 8:35 PM > Subject

Re: IndexDivisor

2009-12-03 Thread Ganesh
: "Danil ŢORIN" To: Sent: Thursday, December 03, 2009 8:35 PM Subject: Re: IndexDivisor Run System.gc() exactly before measuring memory usage. On sun jvm it will FORCE gc (unless DisableExplicitGC is used). On Thu, Dec 3, 2009 at 16:30, Ganesh wrote: > Thanks mike. > > I am ope

Re: IndexDivisor

2009-12-03 Thread Danil ŢORIN
long usedMemory   = runtime.totalMemory() - runtime.freeMemory(); > > Regards > Ganesh > > - Original Message - > From: "Michael McCandless" > To: > Sent: Thursday, December 03, 2009 6:22 PM > Subject: Re: IndexDivisor > > > On Thu, Dec 3, 2009 at 7:

Re: IndexDivisor

2009-12-03 Thread Ganesh
Thanks mike. I am opening the reader and warming it up and then calculating the memory consumed. long usedMemory = runtime.totalMemory() - runtime.freeMemory(); Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Thursday, December 03, 2009 6:22 PM S

Re: IndexDivisor

2009-12-03 Thread Michael McCandless
On Thu, Dec 3, 2009 at 7:15 AM, Ganesh wrote: > Below are my stats > IndexDivisor    Memory >    -1                7 MB >    1                  486 MB >    100              180 MB >    1000            176 MB. Do you simply create the IndexWriter & IndexReader, but do no searching/indexing? How

Re: IndexDivisor

2009-12-03 Thread Ganesh
emory will be allocated / increased. Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Thursday, December 03, 2009 4:47 PM Subject: Re: IndexDivisor How do you measure memory consumption? If you pass -1 for the divisor do you still see no difference? C

Re: IndexDivisor

2009-12-03 Thread Michael McCandless
gt; database with index divisor value 1000, 5000, and 1 and the memory > consumption seems to be same. > > Regards > Ganesh > > - Original Message - > From: "Michael McCandless" > To: > Sent: Thursday, December 03, 2009 4:09 PM > Subject: Re: I

Re: IndexDivisor

2009-12-03 Thread Ganesh
loaded all the database with index divisor value 1000, 5000, and 1 and the memory consumption seems to be same. Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Thursday, December 03, 2009 4:09 PM Subject: Re: IndexDivisor That's indeed ho

Re: IndexDivisor

2009-12-03 Thread Michael McCandless
>> Mike >> >> On Fri, Nov 27, 2009 at 5:16 AM, Ganesh wrote: >>> Thanks, >>> >>> May i know the purpose of using negative value? >>> >>> Regards >>> Ganesh >>> >>> - Original Message - >>>

Re: IndexDivisor

2009-12-03 Thread Ganesh
to IndexDivisor. Regards Ganesh - Original Message - From: "Danil ŢORIN" To: Sent: Friday, November 27, 2009 4:00 PM Subject: Re: IndexDivisor Try to open with very large value (MAX_INT) it will load only first term, and look up the rest from disk. On Fri, Nov 27, 2009 at 1

Re: IndexDivisor

2009-11-27 Thread Danil ŢORIN
wrote: >> Thanks, >> >> May i know the purpose of using negative value? >> >> Regards >> Ganesh >> >> - Original Message - >> From: "Michael McCandless" >> To: >> Sent: Friday, November 27, 2009 3:17 PM >>

Re: IndexDivisor

2009-11-27 Thread Michael McCandless
CPU/RAM by not loading the terms index. Mike On Fri, Nov 27, 2009 at 5:16 AM, Ganesh wrote: > Thanks, > > May i know the purpose of using negative value? > > Regards > Ganesh > > - Original Message - > From: "Michael McCandless" > To: >

Re: IndexDivisor

2009-11-27 Thread Ganesh
Thanks, May i know the purpose of using negative value? Regards Ganesh - Original Message - From: "Michael McCandless" To: Sent: Friday, November 27, 2009 3:17 PM Subject: Re: IndexDivisor > This is the expected behavior. > > If you intend to use the reader for

Re: IndexDivisor

2009-11-27 Thread Michael McCandless
This is the expected behavior. If you intend to use the reader for searching, looking doc freq, deleting docs, etc, you must pass a non-negative value for indexDivisor. Mike On Fri, Nov 27, 2009 at 12:00 AM, Ganesh wrote: > Hello all, > > I am using Lucene v2.9.1, If I open my reader with posit