uot;;
Subject: Re: OutOfMemoryError throwed by SimpleMergedSegmentWarmer
Norms are not stored sparsely by the default codec.
So they take 1 byte per doc per indexed field regardless of whether
that doc had that field.
There is no setting to turn this off in IndexReader, though you could
make
We have 8 million documents and our jvm heap is 5G.
>
>
> Thanks & Best Regards!
>
>
>
>
>
>
> -- Original --
> From: "Michael McCandless";;
> Date: Sat, Sep 13, 2014 06:29 PM
> To: "Lucene Users";
&
ava-user";
Subject: Re: OutOfMemoryError throwed by SimpleMergedSegmentWarmer
Hi, Mike
In our use case, we have thousands of index fields, different kind of
document have different fields. Do you meant that norms field will consume
large memory? Why?
If we decide to disabl
documents and our jvm heap is 5G.
Thanks & Best Regards!
-- Original --
From: "Michael McCandless";;
Date: Sat, Sep 13, 2014 06:29 PM
To: "Lucene Users";
Subject: Re: OutOfMemoryError throwed by SimpleMergedSegmentWarmer
The w
The warmer just tries to load norms/docValues/etc. for all fields that
have them enabled ... so this is likely telling you an IndexReader
would also hit OOME.
You either need to reduce the number of fields you have indexed, or at
least disable norms (takes 1 byte per doc per indexed field regardle
