Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-08-01 Thread roz dev
wow!! That was quick. Thanks a ton. On Wed, Aug 1, 2012 at 11:07 PM, Simon Willnauer wrote: > On Thu, Aug 2, 2012 at 7:53 AM, roz dev wrote: > > Thanks Robert for these inputs. > > > > Since we do not really Snowball analyzer for this field, we would not use > > it

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-08-01 Thread roz dev
On Tue, Jul 31, 2012 at 2:34 PM, roz dev wrote: > > Hi All > > > > I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing > that > > when we are indexing lots of data with 16 concurrent threads, Heap grows > > continuously. It remains high and

Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-07-31 Thread roz dev
Hi All I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing that when we are indexing lots of data with 16 concurrent threads, Heap grows continuously. It remains high and ultimately most of the stuff ends up being moved to Old Gen. Eventually, Old Gen also fills up and we start

Re: Size of lucene norm file

2011-09-18 Thread roz dev
-lucenes-indexing-code-part-2/ as per this link, norms seem to be costly one On Sat, Sep 17, 2011 at 11:59 PM, janwen wrote: > > What is NORM file? > > > > > On 2011-9-18 5:20, roz dev wrote: > >> Hi, >> >> I want to estimate the size of NORM file t

How to estimate the size of lucene .nrm file

2011-09-17 Thread roz dev
Hi, I want to estimate the size of .nrm file that lucene will generate for a 20 Gb index which has 2.5 Million Docs and 50 fields in each document. Is there any formula to predict it? And, what is the RAM cost of this nrm file. Thanks Saroj

Re: Question about MaxFieldLength

2011-08-27 Thread roz dev
Length) return false; > if (input.incrementToken()) { > field1Counter.incrementAndGet(); > return true; >}else{ > return false; > } >} > } > On Sun, Aug 28, 2011 at 9:45 A

Question about MaxFieldLength

2011-08-27 Thread roz dev
Hi All I have a question regarding MaxFieldLength. Is it a limit for number of tokens in 1 field per document or entire index? Example: If MaxFieldLength is set to 100 and I add a document which has 105 tokens for 1 field then I expect 5 tokens to be ignored. but, if i add another document which