I will be running a long running test with jdk1.6u16. If the problem still appears I will try to create a test case to show the issue.
Sumanta -----Original Message----- From: Michael McCandless [mailto:luc...@mikemccandless.com] Sent: Friday, August 21, 2009 4:44 PM To: java-user@lucene.apache.org Subject: Re: Merge Exception in Lucene 2.4 That code looks fine... What OS/filesystem are you using? Can you make a small test case that shows the issue? Mike On Thu, Aug 20, 2009 at 7:41 AM, Sumanta Bhowmik<sumanta.bhow...@guavus.com> wrote: > We put all the IndexWriters in an array which is defined by > > final Directory[] finalDir; > > We also declare an indexer > As > private volatile static Indexer indexer; > > final Indexer finalIndexer = indexer; > > Next we call the merge in a new thread : > > Thread thread = new Thread(){ > public void run() > { > try { > logger.debug("starts merging w/o > optimization"); > > finalIndexer.getWriter().addIndexesNoOptimize(finalDir); > logger.debug("ends merging w/o > optimization"); > > } catch (CorruptIndexException e) { > logger.notice("",e); > } catch (IOException e) { > logger.notice("",e); > } > > } > } > > Sumanta > > > > > -----Original Message----- > From: Michael McCandless [mailto:luc...@mikemccandless.com] > Sent: Thursday, August 20, 2009 3:07 PM > To: java-user@lucene.apache.org > Subject: Re: Merge Exception in Lucene 2.4 > > You should definitely upgrade to the latest JDK 1.6 to get the fix for > the JRE bug in LUCENE-1282, but, I don't think you are hitting that > bug (read past EOF during merge is a different exception). > > Can you describe more detail on how you merge 6 IndexWriters? > > Mike > > On Thu, Aug 20, 2009 at 5:21 AM, Sumanta > Bhowmik<sumanta.bhow...@guavus.com> wrote: >> I checked at http://issues.apache.org/jira/browse/LUCENE-1282 >> SegmentMerger.java has this code >> >> TermFreqVector[] vectors = reader.getTermFreqVectors(docNum); >> termVectorsWriter.addAllDocVectors(vectors); >> >> so this issue appears inspite of this fix. >> >> I am using java version "1.6.0_07". Is it fixed in jdk6u10 and above >> (http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6707044) ? >> >> Regards >> Sumanta >> >> >> -----Original Message----- >> From: Sumanta Bhowmik [mailto:sumanta.bhow...@guavus.com] >> Sent: Thursday, August 20, 2009 1:15 PM >> To: java-user@lucene.apache.org >> Subject: Merge Exception in Lucene 2.4 >> >> Hi >> >> >> >> I am getting this issue in Lucene2.4 when I try to merge multiple >> IndexWriters(generally 6) >> >> >> >> sh-3.2# Exception in thread "Lucene Merge Thread #5" >> org.apache.lucene.index.MergePolicy$MergeException: java.io.IOException: >> read past EOF >> >> at >> > org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(Concur >> rentMergeScheduler.java:309) >> >> at >> > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentM >> ergeScheduler.java:286) >> >> Caused by: java.io.IOException: read past EOF >> >> at >> > org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java >> :135) >> >> at >> > org.apache.lucene.index.CompoundFileWriter.copyFile(CompoundFileWriter.java: >> 228) >> >> at >> > org.apache.lucene.index.CompoundFileWriter.close(CompoundFileWriter.java:184 >> ) >> >> at >> > org.apache.lucene.index.SegmentMerger.createCompoundFile(SegmentMerger.java: >> 204) >> >> at >> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4260) >> >> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3877) >> >> at >> > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeSche >> duler.java:205) >> >> at >> > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentM >> ergeScheduler.java:260) >> >> >> >> >> >> Is this a known issue and has any fix been provided for it ? Would >> appreciate any help. >> >> >> >> Regards >> >> Sumanta >> >> >> >> >> >> >> >> >> __________ NOD32 4349 (20090819) Information __________ >> >> This message was checked by NOD32 antivirus system. >> http://www.eset.com >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> For additional commands, e-mail: java-user-h...@lucene.apache.org >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > __________ NOD32 4350 (20090820) Information __________ > > This message was checked by NOD32 antivirus system. > http://www.eset.com > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org __________ NOD32 4354 (20090821) Information __________ This message was checked by NOD32 antivirus system. http://www.eset.com --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
