>
>
> - Original Message -
> From: "Michael McCandless"
> To:
> Sent: Sunday, December 06, 2009 3:14 PM
> Subject: Re: IndexDivisor
>
>
> You really have to use a profiler, to trust the RAM measurements.
>
> Certain queries, eg function queri
6, 2009 3:14 PM
Subject: Re: IndexDivisor
You really have to use a profiler, to trust the RAM measurements.
Certain queries, eg function queries, can load the field cache. What
kind of queries are you running?
Mike
On Fri, Dec 4, 2009 at 9:11 AM, Ganesh wrote:
> I didn't run with pro
t.. I am opening
> multiple database.
>
> IndexReader opened with IndexDivisor: 100 //Open the reader with the divisor
> value
> TermCount: 7046764 //Available unique terms
> in the db
> Warmup done:
I didn't run with profiler. I created a test app and run that.. I am opening
multiple database.
IndexReader opened with IndexDivisor: 100 //Open the reader with the divisor
value
TermCount: 7046764 //Available unique terms
in the db
Warmup
doing sorting.
>
> Regards
> Ganesh
>
>
>
> - Original Message -
> From: "Michael McCandless"
> To:
> Sent: Thursday, December 03, 2009 9:35 PM
> Subject: Re: IndexDivisor
>
>
> Can you run w/ a memory profiler? I don't trust that gc
close all the searcher and reader.
There is no deletions, no norms and i am not doing sorting.
Regards
Ganesh
- Original Message -
From: "Michael McCandless"
To:
Sent: Thursday, December 03, 2009 9:35 PM
Subject: Re: IndexDivisor
Can you run w/ a memory profiler? I d
Maybe the command line argument "-verbose:gc output" would help to
determine if GC is running.
But you are right - a profiler would be the best way.
Benjamin
-
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For a
Can you run w/ a memory profiler? I don't trust that gc is truly running.
Mike
On Thu, Dec 3, 2009 at 10:47 AM, Ganesh wrote:
> I am doing GC before calculating the memory. Even i set my indexdivisor to
> 1 but there seems to be no change.
>
> Below are my stats
>
I am doing GC before calculating the memory. Even i set my indexdivisor to
1 but there seems to be no change.
Below are my stats
IndexDivisor Memory
-1 7 MB
1 486 MB
100 180 MB
1000 176 MB.
1176MB
Regards
Ganesh
- Original Message -
From
long usedMemory = runtime.totalMemory() - runtime.freeMemory();
>
> Regards
> Ganesh
>
> - Original Message -
> From: "Michael McCandless"
> To:
> Sent: Thursday, December 03, 2009 6:22 PM
> Subject: Re: IndexDivisor
>
>
> On Thu, Dec 3, 2009 at 7:
ubject: Re: IndexDivisor
On Thu, Dec 3, 2009 at 7:15 AM, Ganesh wrote:
> Below are my stats
> IndexDivisor Memory
> -1 7 MB
> 1 486 MB
> 100 180 MB
> 1000 176 MB.
Do you simply create the IndexWriter & IndexReader, but do no
searching/indexing?
How are you measuring RAM
On Thu, Dec 3, 2009 at 7:15 AM, Ganesh wrote:
> Below are my stats
> IndexDivisor Memory
> -1 7 MB
> 1 486 MB
> 100 180 MB
> 1000 176 MB.
Do you simply create the IndexWriter & IndexReader, but do no
se
I don't have deletions. No norms. No sorting.
I am setting 70 MB for IndexWriter RamBuffer but not indexing any documents.
Swtiched off indexing.
I have enabled TermVector for one field.
I am opening all 30 database with different value of indexdivisor.
Below are my stats
IndexDi
gt; database with index divisor value 1000, 5000, and 1 and the memory
> consumption seems to be same.
>
> Regards
> Ganesh
>
> - Original Message -
> From: "Michael McCandless"
> To:
> Sent: Thursday, December 03, 2009 4:09 PM
> Subject: Re: I
loaded all the
database with index divisor value 1000, 5000, and 1 and the memory
consumption seems to be same.
Regards
Ganesh
- Original Message -
From: "Michael McCandless"
To:
Sent: Thursday, December 03, 2009 4:09 PM
Subject: Re: IndexDivisor
That's indeed ho
>> Mike
>>
>> On Fri, Nov 27, 2009 at 5:16 AM, Ganesh wrote:
>>> Thanks,
>>>
>>> May i know the purpose of using negative value?
>>>
>>> Regards
>>> Ganesh
>>>
>>> - Original Message -
>>>
Thanks.
IndexDivisor means, When set to N, then one in every N*termIndexInterval terms
in the index is loaded into memory.
For example i am having 100,000 unique terms and termIndexInterval set to 5
then (10 / (5*128) ) terms (==X terms)will be loaded in to memory.
If termIndexInterval is
wrote:
>> Thanks,
>>
>> May i know the purpose of using negative value?
>>
>> Regards
>> Ganesh
>>
>> - Original Message -
>> From: "Michael McCandless"
>> To:
>> Sent: Friday, November 27, 2009 3:17 PM
>>
Sent: Friday, November 27, 2009 3:17 PM
> Subject: Re: IndexDivisor
>
>
>> This is the expected behavior.
>>
>> If you intend to use the reader for searching, looking doc freq,
>> deleting docs, etc, you must pass a non-negative value for
>> indexDivisor.
>>
Thanks,
May i know the purpose of using negative value?
Regards
Ganesh
- Original Message -
From: "Michael McCandless"
To:
Sent: Friday, November 27, 2009 3:17 PM
Subject: Re: IndexDivisor
> This is the expected behavior.
>
> If you intend to use the reader for
This is the expected behavior.
If you intend to use the reader for searching, looking doc freq,
deleting docs, etc, you must pass a non-negative value for
indexDivisor.
Mike
On Fri, Nov 27, 2009 at 12:00 AM, Ganesh wrote:
> Hello all,
>
> I am using Lucene v2.9.1, If I open my re
Hello all,
I am using Lucene v2.9.1, If I open my reader with positive value for
termInfosIndexDivisor then the search works fine. If i set to -1, then search
throws exception "terms index was not loaded when this reader was created". Is
this the intend behaviour?
I thought by setting this va
22 matches
Mail list logo
