Hi Grant, I have now followed Daniel's advice and catch the exception with:
try { indexWriter.addDocument(doc); } catch (CorruptIndexException ex) { throw new IndexerException ("CorruptIndexException on doc: " + doc.toString(), ex); } catch (IOException ex) { throw new IndexerException ("*IOException* on doc: " + doc.toString(), ex); } The result now appears as: 2009-09-02 10:14:24,014 ERROR [QueueManager] [BatchUpdater.processMods:183] Failed to add content document(s) for user 0bb00000daaa2864-9.0.61.271 com.scalix.index.api.IndexerException: *IOException* on doc: Document<indexed,tokenized<return-path:christian.sho...@scalix.com> indexed,tokenized<received:from scalixmail.scalix.com (localhost [127.0.0.1]) by scalixmail.scalix.com (8.13.6/8.13.6/SuSE Linux 0.8) with ESMTP id m0F9545p008012; Tue, 15 Jan 2008 04:05:05 -0500> indexed,tokenized<received:from [10.13.1.51] (scalixmail.scalix.com [172.16.0.9]) by scalixmail.scalix.com (Scalix SMTP Relay 11.3.0.11339) via ESMTP; Tue, 15 Jan 2008 04:05:05 -0500 (EST)> indexed<CREATE-DATE:20080115090228> indexed,tokenized<date:Tue Jan 15 04:02:28 EST 2008> indexed,tokenized<from:"Christian Sholtz" <christian.sho...@scalix.com>> indexed,tokenized<to:SIN - Robert Smith <Robert.Smi t...@sin.co.at>> indexed,tokenized<cc:Patrick Lauria <patr...@scalix.com>> indexed<message-id:478c76a4.2090...@scalix.com> indexed<in-reply-to:h000007b0031e9f3.1200380510.scalix.sin.co...@mhs> indexed<references:h000007b0031e9f3.1200380510.scalix.sin.co...@mhs> indexed,tokenized<subject: Re: AW: Lead Landwirtschaftskammer Kärnten -> Smith> indexed,tokenized<autoforwarded:FALSE> indexed,tokenized<importance:Normal> indexed,tokenized<priority:Normal> indexed,tokenized<sensitivity:Normal> indexed,tokenized<x-msmail-priority:Medium> indexed,tokenized<x-priority:3> indexed<x-scalix-autoreplied:FALSE> indexed,tokenized<user-agent:Thunderbird 2.0.0.9 (Windows/20071031)> indexed,tokenized<x-spam-status:No, score=-1.3 required=5.0 tests=AWL,BAYES_00, SUBJECT_ENCODED_TWICE autolearn=no version=3.1.8> indexed,tokenized<x-spam-checker-version:SpamAssassin 3.1.8 (2007-02-13) on scalixmail.scalix.com> indexed,tokenized<x-mime-autoconverted:from 8bit to quoted-printable by scalixmail.scalix.com id m0F9545p00801 2> indexed,tokenized<mime-version:1.0> indexed<SIZE-KBYTES:0000000006> indexed<DELIVERY-DATE:20080115090509> indexed,tokenized<x-scalix-internaldate:Tue Jan 15 04:05:09 EST 2008> indexed<x-scalix-has-attach:FALSE> indexed,tokenized<content-type:text/plain; charset="ISO-8859-1"; format="flowed"> indexed,tokenized<content-transfer-encoding:quoted-printable> indexed,tokenized<content-disposition:inline> indexed<CONTENT-TYPE:text/plain> indexed,tokenized<BODY:java.io.inputstreamrea...@75b940> indexed<x-scalix-class:IPM.Note> indexed<MSG-TYPE:email> stored/uncompressed,indexed<INDEXID:90010ac-4682aaad-478c7745-2ee4ab>> at com.scalix.index.manager.BatchUpdater.performContentAdds(BatchUpdater.java:394) at com.scalix.index.manager.BatchUpdater.processMods(BatchUpdater.java:179) at com.scalix.index.manager.QueueManager.processQueue(QueueManager.java:134) at com.scalix.index.manager.QueueManager.run(QueueManager.java:81) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Stream closed at sun.nio.cs.StreamDecoder.ensureOpen(Unknown Source) at sun.nio.cs.StreamDecoder.read(Unknown Source) at java.io.InputStreamReader.read(Unknown Source) at org.apache.lucene.analysis.standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java:443) at org.apache.lucene.analysis.standard.StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:629) at org.apache.lucene.analysis.standard.StandardTokenizer.next(StandardTokenizer.java:140) at org.apache.lucene.analysis.standard.StandardFilter.next(StandardFilter.java:43) at org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java:34) at org.apache.lucene.analysis.snowball.SnowballFilter.next(SnowballFilter.java:64) at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:134) at org.apache.lucene.index.DocFieldConsumersPerField.processFields(DocFieldConsumersPerField.java:36) at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:234) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:765) at org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:743) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1902) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1880) at com.scalix.index.manager.BatchUpdater.performContentAdds(BatchUpdater.java:390) ... 4 more Does this help? Thanks, - Chris ----- Original Message ----- From: Daniel Shane <sha...@lexum.umontreal.ca> Sent: Tue, 1/9/2009 10:52pm To: java-user@lucene.apache.org Subject: Re: New "Stream closed" exception with Java 6 I think you should do this instead (it will print the exception message *and* the stack trace instead of only the message) : throw new IndexerException ("CorruptIndexException on doc: " + doc.toString(), ex); Daniel Shane Chris Bamford wrote: > Hi Grant, > > >>> I think you code there needs to show the underlying exception, too, so >>> we can see that stack trace. >>> > > Ummm... isn't this code already doing that? What am I missing? > > try { > > indexWriter.addDocument(doc); > > } catch (CorruptIndexException ex) { > > throw new IndexerException ("CorruptIndexException on doc: " > + doc.toString() + > > " - " + ex.toString()); > > } catch (IOException ex) { > > throw new IndexerException ("IOException on doc: " + > doc.toString() + > > " - " + ex.toString()); > > } > > Thanks, > > - Chris > > Chris Bamford > Senior Development Engineer > Scalix > chris.bamf...@scalix.com > Tel: +44 (0)1344 381814 > www.scalix.com > > > > ----- Original Message ----- > From: Grant Ingersoll <gsing...@apache.org> > Sent: Sat, 29/8/2009 12:00pm > To: java-user@lucene.apache.org > Subject: Re: New "Stream closed" exception with Java 6 > > I think you code there needs to show the underlying exception, too, so > we can see that stack trace. > > -Grant > > On Aug 28, 2009, at 11:47 AM, Chris Bamford wrote: > > >> Hi Grant >> >> Please see attached. >> >> Thanks, >> >> - Chris >> >> >> ----- Original Message ----- >> From: Grant Ingersoll <gsing...@apache.org> >> Sent: Fri, 28/8/2009 1:26pm >> To: java-user@lucene.apache.org >> Subject: Re: New "Stream closed" exception with Java 6 >> >> Are there any log messages around that spot? Did something happen to >> the underlying Reader you are using? Can you share that little bit of >> indexing code? >> >> On Aug 27, 2009, at 10:11 AM, Chris Bamford wrote: >> >> >>> Hi, >>> >>> Since moving our app to Java 6 and Tomcat 6, we have started getting >>> occasional exceptions of the form: >>> >>> java.io.IOException: Stream closed >>> at sun.nio.cs.StreamDecoder.ensureOpen(Unknown Source) >>> at sun.nio.cs.StreamDecoder.read(Unknown Source) >>> at java.io.InputStreamReader.read(Unknown Source) >>> at >>> org >>> .apache >>> .lucene >>> .analysis >>> .standard.StandardTokenizerImpl.zzRefill(StandardTokenizerImpl.java: >>> 443) >>> at >>> org >>> .apache >>> .lucene >>> .analysis >>> .standard >>> .StandardTokenizerImpl.getNextToken(StandardTokenizerImpl.java:629) >>> at >>> org >>> .apache >>> .lucene >>> .analysis.standard.StandardTokenizer.next(StandardTokenizer.java:140) >>> at >>> org >>> .apache >>> .lucene.analysis.standard.StandardFilter.next(StandardFilter.java:43) >>> at >>> org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java: >>> 34) >>> at >>> org >>> .apache >>> .lucene.analysis.snowball.SnowballFilter.next(SnowballFilter.java:64) >>> at >>> org >>> .apache >>> .lucene >>> .index.DocInverterPerField.processFields(DocInverterPerField.java: >>> 134) >>> at >>> org >>> .apache >>> .lucene >>> .index >>> .DocFieldConsumersPerField >>> .processFields(DocFieldConsumersPerField.java:36) >>> at >>> org >>> .apache >>> .lucene >>> .index >>> .DocFieldProcessorPerThread >>> .processDocument(DocFieldProcessorPerThread.java:234) >>> at >>> org >>> .apache >>> .lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java: >>> 765) >>> at >>> org >>> .apache >>> .lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:743) >>> at >>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java: >>> 1902) >>> at >>> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java: >>> 1880) >>> at >>> com >>> .scalix >>> .index.manager.BatchUpdater.performContentAdds(BatchUpdater.java:386) >>> at >>> com.scalix.index.manager.BatchUpdater.processMods(BatchUpdater.java: >>> 176) >>> at >>> com.scalix.index.manager.QueueManager.processQueue(QueueManager.java: >>> 134) >>> at com.scalix.index.manager.QueueManager.run(QueueManager.java:81) >>> at java.lang.Thread.run(Unknown Source) >>> >>> We are using Lucene 2.4. Any ideas what is happening? >>> >>> Thanks! >>> >>> - Chris >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >>> For additional commands, e-mail: java-user-h...@lucene.apache.org >>> >>> >> -------------------------- >> Grant Ingersoll >> http://www.lucidimagination.com/ >> >> Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) >> using Solr/Lucene: >> http://www.lucidimagination.com/search >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> For additional commands, e-mail: java-user-h...@lucene.apache.org >> >> <lucene_msg.txt> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> For additional commands, e-mail: java-user-h...@lucene.apache.org >> > > -------------------------- > Grant Ingersoll > http://www.lucidimagination.com/ > > Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) > using Solr/Lucene: > http://www.lucidimagination.com/search > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org