Re: Exception while doing sorting

2008-09-23 Thread Erick Erickson
10 - 20 secs to dispaly the results sorted on string field. [I am not > opening indexsearcher every time]. > > Regards > Ganesh > > > > - Original Message - From: "Erick Erickson" < > [EMAIL PROTECTED]> > To: > Sent: Monday, September 22, 200

Re: Exception while doing sorting

2008-09-22 Thread Ganesh - yahoo
6:29 PM Subject: Re: Exception while doing sorting Sure, your tomcat instance is assigning some amount of memory to the JVM that your searcher is running in. Of course, now you're going to ask me now to increase that number... I have no idea but I've seen this question multiple times

Re: Exception while doing sorting

2008-09-22 Thread Dipen
out of memory exception is occured. > > Could any one clarify it? > > Regards > Ganesh > > - Original Message - From: "Ganesh - yahoo" <[EMAIL PROTECTED] > > > To: > Sent: Friday, September 19, 2008 10:56 AM > > Subject: Re: Exception

Re: Exception while doing sorting

2008-09-22 Thread Erick Erickson
t; > Regards > Ganesh > > - Original Message - From: "Ganesh - yahoo" <[EMAIL PROTECTED] > > > To: > Sent: Friday, September 19, 2008 10:56 AM > > Subject: Re: Exception while doing sorting > > > Ok. If i distribure the indexes, whether

Re: Exception while doing sorting

2008-09-22 Thread Ganesh - yahoo
is occured. Could any one clarify it? Regards Ganesh - Original Message - From: "Ganesh - yahoo" <[EMAIL PROTECTED]> To: Sent: Friday, September 19, 2008 10:56 AM Subject: Re: Exception while doing sorting Ok. If i distribure the indexes, whether sorting woul

Re: Exception while doing sorting

2008-09-18 Thread Ganesh - yahoo
To: Sent: Thursday, September 18, 2008 12:17 PM Subject: Re: Exception while doing sorting If your index is increasing in size so fast, you should start thinking about sharding your index (breaking it into multiple smaller indices that each fits on its server) and searching across them (ak

Re: Exception while doing sorting

2008-09-17 Thread Otis Gospodnetic
and if used correctly. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Ganesh - yahoo <[EMAIL PROTECTED]> > To: java-user@lucene.apache.org > Sent: Thursday, September 18, 2008 12:53:19 AM > Subject: Re: Exception while doi

Re: Exception while doing sorting

2008-09-17 Thread Ganesh - yahoo
- From: "Fuad Efendi" <[EMAIL PROTECTED]> To: Sent: Wednesday, September 17, 2008 7:28 PM Subject: Re: Exception while doing sorting Increase memory. Lucene uses FieldCache for sorting on non-tokenized field and tries to maintain fields from all your 4 millions documents,

Re: Exception while doing sorting

2008-09-17 Thread Erick Erickson
<<>> Does this mean you close/open your searcher every minute? If so, this could be the root of why your sorting is taking so long. Although it's not the OOM problem, see Faud's email. The first few searches on a newly opened searcher do a lot of setup, which is very expensive. A 50 second search

Re: Exception while doing sorting

2008-09-17 Thread Fuad Efendi
Increase memory. Lucene uses FieldCache for sorting on non-tokenized field and tries to maintain fields from all your 4 millions documents, even if you need to sort only 4000 docs. == http://www.tokenizer.org/bot.html Quoting Ganesh - yahoo <[EMAIL PROTECTED]>: Hello all, I