RE: Merge Exception in Lucene 2.4

2009-08-27 Thread Sumanta Bhowmik
Hi I am not sure if the -Xint option works as the performance goes down like anything. Since I am indexing streaming data -Xint is not an option. Is it possible that we do the merge synchronously so that I can catch the exception, clean the index and start afresh. Even if it is asynchronous if the

Re: Bizarre indexing issue where thousands of files get created

2009-08-27 Thread Micah Jaffe
Unfortunately, there's no concise summarization of the code to post. As a follow-up to the situation, after throwing more RAM at the problem (from 2GB to 10GB of process space) we no longer see OOM errors and also no longer see the IndexWriter create thousands of files; the OOM error did ap

Lucene 2.9 RC1 now available for testing

2009-08-27 Thread Mark Miller
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello Lucene users, On behalf of the Lucene dev community (a growing community far larger than just the committers) I would like to announce the first release candidate for Lucene 2.9. Please download and check it out – take it for a spin and kick th

Re: Lucene SORT does a sort on entire index..how do I filter SORT?

2009-08-27 Thread javaguy44
Hi Jason, Thanks v much for your replies + help. I got it - all is swell. Thx again Jason Rutherglen-2 wrote: > > Only the results from the query should be sorted. The field > caches do get loaded for all values of a field though, is that > what you're seeing? > > On Fri, Aug 21, 2009 at 4:

Re: Lucene gobbling file descriptors

2009-08-27 Thread Andrzej Bialecki
Erick Erickson wrote: Note that for search speed reasons, you really, really want to share your readers and NOT open/close for every request. FWIW Erick On Thu, Aug 27, 2009 at 9:10 AM, Chris Bamford wrote: I'm glad its not normal. That means we can fix it! I will conduct a review of IndexRe

Re: Lucene gobbling file descriptors

2009-08-27 Thread Erick Erickson
Note that for search speed reasons, you really, really want to share your readers and NOT open/close for every request. FWIW Erick On Thu, Aug 27, 2009 at 9:10 AM, Chris Bamford wrote: > I'm glad its not normal. That means we can fix it! I will conduct a > review of IndexReader/Searcher open/cl

Re: Lucene in Action Rev2

2009-08-27 Thread tsuraan
> I've pinged Manning to get this corrected. Thanks for the heads-up. > > Erik No problem. I'm about to order the beta book, and I'm looking forward to the final copy. Thanks for writing it :) - To unsubscribe, e-mail: j

Announcing Dutch Lucene User Group

2009-08-27 Thread Uri Boness
Hi, We started a new Lucene user group in The Netherlands. In the last couple of years we've notice an increasing demand and interest in Lucene and Solr. We thought it's about time to have a centralize place where people can have open discussions, trainings, and periodic meet-ups to share kno

New "Stream closed" exception with Java 6

2009-08-27 Thread Chris Bamford
Hi, Since moving our app to Java 6 and Tomcat 6, we have started getting occasional exceptions of the form: java.io.IOException: Stream closed at sun.nio.cs.StreamDecoder.ensureOpen(Unknown Source) at sun.nio.cs.StreamDecoder.read(Unknown Source) at java.io.InputStreamReader.read(Un

RE: Lucene gobbling file descriptors

2009-08-27 Thread Chris Bamford
I'm glad its not normal. That means we can fix it! I will conduct a review of IndexReader/Searcher open/close ops. Thanks! Chris - Original Message - From: Michael McCandless Sent: Wed, 26/8/2009 2:26pm To: java-user@lucene.apache.org Subject: Re: Lucene gobbling file descriptors Th

Re: Merge Exception in Lucene 2.4

2009-08-27 Thread Michael McCandless
Was this a smallish contained test case? Can you post the sources? Can you run your next test with IndexWriter's infoStream turned on, and post the resluting output? Was this with jdk1.6u16? That version fixes the original hotspot bug from LUCENE-1282... (and your exception looks different from