RE: Merge Exception in Lucene 2.4

2009-08-28 Thread Sumanta Bhowmik
, August 28, 2009 10:56 AM To: java-user@lucene.apache.org Cc: luc...@mikemccandless.com Subject: RE: Merge Exception in Lucene 2.4 Hi I am not sure if the -Xint option works as the performance goes down like anything. Since I am indexing streaming data -Xint is not an option. Is it possible that we

RE: Merge Exception in Lucene 2.4

2009-08-27 Thread Sumanta Bhowmik
there is a way to know the status of the merge operation? Sumanta -Original Message- From: Michael McCandless [mailto:luc...@mikemccandless.com] Sent: Thursday, August 27, 2009 2:30 PM To: Sumanta Bhowmik Cc: java-user@lucene.apache.org Subject: Re: Merge Exception in Lucene 2.4 Was this a

Re: Merge Exception in Lucene 2.4

2009-08-27 Thread Michael McCandless
n 2.6.26-79.fc9 , gcc version 4.1.2 20071124 > (Red Hat 4.1.2-42) > > This exception occurs after we have indexed more than 100 gb of data. I will > try running with -Xint to see if I can avoid this exception. > > Regards > Sumanta > > -----Original Message- > From:

RE: Merge Exception in Lucene 2.4

2009-08-26 Thread Sumanta Bhowmik
August 24, 2009 1:10 PM To: java-user@lucene.apache.org Subject: RE: Merge Exception in Lucene 2.4 I will be running a long running test with jdk1.6u16. If the problem still appears I will try to create a test case to show the issue. Sumanta -Original Message- From: Michael McCandless [

RE: Merge Exception in Lucene 2.4

2009-08-24 Thread Sumanta Bhowmik
@lucene.apache.org Subject: Re: Merge Exception in Lucene 2.4 That code looks fine... What OS/filesystem are you using? Can you make a small test case that shows the issue? Mike On Thu, Aug 20, 2009 at 7:41 AM, Sumanta Bhowmik wrote: > We put all the IndexWriters in an array which is defined by > &

Re: Merge Exception in Lucene 2.4

2009-08-21 Thread Michael McCandless
,e); >                                } > >        } > } > > Sumanta > > > > > -Original Message----- > From: Michael McCandless [mailto:luc...@mikemccandless.com] > Sent: Thursday, August 20, 2009 3:07 PM > To: java-user@lucene.apache.org > Subject:

RE: Merge Exception in Lucene 2.4

2009-08-20 Thread Sumanta Bhowmik
} catch (IOException e) { logger.notice("",e); } } } Sumanta -Original Message- From: Michael McCandless [mailto:luc...@mikemccandless.com] Sent: Thursday, August 20, 2009 3:07 PM To: java-user@lucene

Re: Merge Exception in Lucene 2.4

2009-08-20 Thread Michael McCandless
You should definitely upgrade to the latest JDK 1.6 to get the fix for the JRE bug in LUCENE-1282, but, I don't think you are hitting that bug (read past EOF during merge is a different exception). Can you describe more detail on how you merge 6 IndexWriters? Mike On Thu, Aug 20, 2009 at 5:21 AM

RE: Merge Exception in Lucene 2.4

2009-08-20 Thread Sumanta Bhowmik
I checked at http://issues.apache.org/jira/browse/LUCENE-1282 SegmentMerger.java has this code TermFreqVector[] vectors = reader.getTermFreqVectors(docNum); termVectorsWriter.addAllDocVectors(vectors); so this issue appears inspite of this fix. I am using java version "1.6.0_07". Is it fixed in