Re: MergeException: java.io.IOException: File too large

2012-09-10 Thread Gully Burns
43524, 8343525, 8343526, 8343527, 8343528, 8343529, >> 8343530, >> > 8343531, ... (100 adds)]} 0 60 >> > Sep 8, 2012 9:30:11 PM org.apache.solr.core.SolrCore execute >> > INFO: [ArticleCitation] webapp=/solr path=/update >> > params={wt=xml&version=

Re: MergeException: java.io.IOException: File too large

2012-09-10 Thread Gully Burns
.apache.solr.update.DirectUpdateHandler2 commit > > INFO: start > > > commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false) > > > > Exception in thread "Lucene Merge Thread #0" > > org.apa

Re: MergeException: java.io.IOException: File too large

2012-09-10 Thread Michael McCandless
gt; commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false) > > Exception in thread "Lucene Merge Thread #0" > org.apache.lucene.index.MergePolicy$MergeException: java.io.IOException: > File too large > at > org.apache

MergeException: java.io.IOException: File too large

2012-09-09 Thread Gully Burns
rt commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false) Exception in thread "Lucene Merge Thread #0" org.apache.lucene.index.MergePolicy$MergeException: java.io.IOException: File too large at org.apache.lucene.index.ConcurrentMergeScheduler.h

Re: Exception in thread "Lucene Merge Thread #3" MergePolicy$MergeException: java.io.IOException: Data error (cyclic redundancy check)

2010-04-15 Thread liat oren
Ok, thank you! No, the full traceback is: Exception in thread "Lucene Merge Thread #3" P.Lucene.Expert.index.MergePolicy$MergeException: java.io.IOException: Data error (cyclic redundancy check) at P.Lucene.Expert.index.ConcurrentMergeScheduler.handleMerg

Re: Exception in thread "Lucene Merge Thread #3" MergePolicy$MergeException: java.io.IOException: Data error (cyclic redundancy check)

2010-04-15 Thread Michael McCandless
liat oren wrote: > Hi All, > I got the following error while trying to optimize index sized 31 GB: > Exception in thread "Lucene Merge Thread #3" > P.Lucene.Expert.index.MergePolicy$MergeException: java.io.IOException: Data > error (cy

Exception in thread "Lucene Merge Thread #3" MergePolicy$MergeException: java.io.IOException: Data error (cyclic redundancy check)

2010-04-15 Thread liat oren
Hi All, I got the following error while trying to optimize index sized 31 GB: Exception in thread "Lucene Merge Thread #3" P.Lucene.Expert.index.MergePolicy$MergeException: java.io.IOException: Data error (cyclic redundancy check)

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-30 Thread jm
On Mon, Nov 30, 2009 at 2:34 PM, Michael McCandless wrote: > On Mon, Nov 30, 2009 at 7:22 AM, jm wrote: >> No other exceptions I could spot. > > OK > >> OS: win2003 32bits, with NTFS. This is a vm running on vmware fusion on a >> mac. > > That should be fine... > >> jvm: I made sure, java versio

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-30 Thread Michael McCandless
On Mon, Nov 30, 2009 at 7:22 AM, jm wrote: > No other exceptions I could spot. OK > OS: win2003 32bits, with NTFS. This is a vm running on vmware fusion on a mac. That should be fine... > jvm: I made sure, java version "1.6.0_14" Good. > IndexWriter settings: >        writer.setMaxFieldLengt

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-30 Thread jm
67700 tokens] >>    test: stored fields...OK [3 total field count; avg 1 fields per doc] >>    test: term vectorsOK [0 total vector count; avg 0 >> term/freq vector fields per doc] >> >>  12 of 12: name=_8n5 docCount=122 >>    compound=true >>    hasProx=true >>

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread jm
>> 267700 tokens] >>    test: stored fields...OK [3 total field count; avg 1 fields per doc] >>    test: term vectorsOK [0 total vector count; avg 0 >> term/freq vector fields per doc] >> >>  12 of 12: name=_8n5 docCount=122 >>

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread Michael McCandless
uld be nice to give any hint about the index >> (path in case of a fsdirectory etc) when found an exception, dont >> assume there is a single index in the application. >> >> javier >> >> On Fri, Nov 27, 2009 at 11:39 AM, Michael McCandless >>

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread Michael McCandless
On Fri, Nov 27, 2009 at 6:23 AM, jm wrote: > Ok, I got the index from the production machine, but I am having some > problem to find the index..., our process deals with multiple indexes, > in the current exception I cannot see any indication about the index > having the issue.  I opened all my in

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread jm
>>>> on second thought...I hadnt noticed the jdk numbers properly, we are >>>>>> using using b28, and JDK 6 Update 10 (b28) is the one fixing this... >>>>>> >>>>>> ok forget this then >>>&g

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread jm
DK 6 Update 10 (b28) is the one fixing this... >>>>> >>>>> ok forget this then >>>>> thanks! >>>>> >>>>> On Thu, Nov 26, 2009 at 11:55 AM, jm wrote: >>>>>> Hi, >>>>>> &g

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-27 Thread Michael McCandless
e fixing this... >>>> >>>> ok forget this then >>>> thanks! >>>> >>>> On Thu, Nov 26, 2009 at 11:55 AM, jm wrote: >>>>> Hi, >>>>> >>>>> Dont know if this should be here or in java-dev, p

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-26 Thread jm
his... >>> >>> ok forget this then >>> thanks! >>> >>> On Thu, Nov 26, 2009 at 11:55 AM, jm wrote: >>>> Hi, >>>> >>>> Dont know if this should be here or in java-dev, posting to this one >>>&

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-26 Thread Michael McCandless
stallations, we have encountered an exception: >>> >>> Exception in thread "Lucene Merge Thread #0" >>> org.apache.lucene.index.MergePolicy$MergeException: >>> org.apache.lucene.index.CorruptIndexException: docs out of order >>> (2

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-26 Thread jm
> >> Exception in thread "Lucene Merge Thread #0" >> org.apache.lucene.index.MergePolicy$MergeException: >> org.apache.lucene.index.CorruptIndexException: docs out of order >> (24658 <= 24658 ) >>        at >> org.apache.lucene

Re: MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-26 Thread jm
this one > first. In one of our installations, we have encountered an exception: > > Exception in thread "Lucene Merge Thread #0" > org.apache.lucene.index.MergePolicy$MergeException: > org.apache.lucene.index.CorruptIndexException: docs out of ord

MergePolicy$MergeException CorruptIndexException in lucene2.4.1

2009-11-26 Thread jm
Hi, Dont know if this should be here or in java-dev, posting to this one first. In one of our installations, we have encountered an exception: Exception in thread "Lucene Merge Thread #0" org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.index.CorruptIndexException

Re: MergePolicy$MergeException because of FileNotFoundException because wrong path to index-file

2009-08-31 Thread Michael McCandless
gt; I have no idea what is different here because we use the same code > successfully on other machines (even multi-core) > 1. 2009.08.28 13:10:30 : > [B:600000043][N:org.apache.lucene.index.MergePolicy$MergeException] > org.apache.lucene.index.MergePolicy$MergeException: > java.io.Fil

AW: MergePolicy$MergeException because of FileNotFoundException because wrong path to index-file

2009-08-31 Thread Uwe Goetzke
Ups, sorry 2.4.1 Thx Uwe Goetzke -Ursprüngliche Nachricht- Von: Uwe Schindler [mailto:u...@thetaphi.de] Gesendet: Montag, 31. August 2009 17:42 An: java-user@lucene.apache.org Betreff: RE: MergePolicy$MergeException because of FileNotFoundException because wrong path to index-file

RE: MergePolicy$MergeException because of FileNotFoundException because wrong path to index-file

2009-08-31 Thread Uwe Schindler
o: java-user@lucene.apache.org > Subject: MergePolicy$MergeException because of FileNotFoundException > because wrong path to index-file > > We have an IndexWriter.optimize running on 4 Proc Xenon Java 1.5 Win2003 > machine. > We get a repeatable FileNotFoundException because the path to the

MergePolicy$MergeException because of FileNotFoundException because wrong path to index-file

2009-08-31 Thread Uwe Goetzke
\s_index1251456210140\_0. cfs I have no idea what is different here because we use the same code successfully on other machines (even multi-core) 1. 2009.08.28 13:10:30 : [B:60043][N:org.apache.lucene.index.MergePolicy$MergeException] org.apache.lucene.index.MergePolicy$MergeException

Re: org.apache.lucene.index.MergePolicy$MergeException

2009-08-05 Thread tsuraan
On 05/08/2009, Michael McCandless wrote: > Switching to addIndexes instead, or using SerialMergeScheduler, or > upgrading to 2.4.1, should all work. Thanks! We'll be switching to 2.9 once it's ready. From past experience, lucene upgrades are simple and painless, but I don't think I can do a 2.4

Re: org.apache.lucene.index.MergePolicy$MergeException

2009-08-05 Thread Michael McCandless
Switching to addIndexes instead, or using SerialMergeScheduler, or upgrading to 2.4.1, should all work. Mike On Wed, Aug 5, 2009 at 12:26 PM, tsuraan wrote: > I'm getting the exception > "org.apache.lucene.index.MergePolicy$MergeException: segment "_0 > exists in ex

org.apache.lucene.index.MergePolicy$MergeException

2009-08-05 Thread tsuraan
I'm getting the exception "org.apache.lucene.index.MergePolicy$MergeException: segment "_0 exists in external directory yet the MergeScheduler executed the merge in a separate thread". According to this: http://mail-archives.apache.org/mod_mbox/lucene-java-user/200809.mbox

Re: MergeException

2009-04-21 Thread Christiaan Fluit
Michael McCandless wrote: On Tue, Apr 21, 2009 at 4:26 PM, Christiaan Fluit wrote: I have experienced similar problems (see the "semi-infinite loop during merging" thread - still working out the problem): the merger gets into an infinite loop and causes my drive to be filled with temporary file

Re: MergeException

2009-04-21 Thread Michael McCandless
On Tue, Apr 21, 2009 at 4:26 PM, Christiaan Fluit wrote: > I have experienced similar problems (see the "semi-infinite loop during > merging" thread - still working out the problem): the merger gets into an > infinite loop and causes my drive to be filled with temporary files that are > not delete

Re: MergeException

2009-04-21 Thread Michael McCandless
g Lucene 2.4.1. for building an ngram index. Indexing works > well until I try to open the index built so far with Luke. A > MergeException is thrown, see below. Opening an index with Luke during > indexing never caused problems with Lucene 2.3. Anyone familiar with > this problem? > &g

Re: MergeException

2009-04-21 Thread Christiaan Fluit
ts with a MergeException wrapping one of a variety of IOExceptions (e.g. a FileNotFoundException), sometimes it just keeps on consuming all available CPU time. I think the "_k0z.fnm" file name indicates that a lot of segments have already been created, as it starts iterating with _0, _1,

MergeException

2009-04-21 Thread Martine Woudstra
Hi all, I'm using Lucene 2.4.1. for building an ngram index. Indexing works well until I try to open the index built so far with Luke. A MergeException is thrown, see below. Opening an index with Luke during indexing never caused problems with Lucene 2.3. Anyone familiar with this pr

Re: MergePolicy$MergeException during IndexWriter.addIndexesNoOptimize

2009-02-04 Thread Michael McCandless
ene does not catch or log it either. Thank you in advance, Dave Exception in thread "Thread-5" org.apache.lucene.index.MergePolicy$MergeException: java.io.FileNotFoundException: /entixd/dfertig/indexes/moreover/20090115/0/_0.cfs (No such file or directory) at org

MergePolicy$MergeException during IndexWriter.addIndexesNoOptimize

2009-02-02 Thread David Fertig
ception in thread "Thread-5" org.apache.lucene.index.MergePolicy$MergeException: java.io.FileNotFoundException: /entixd/dfertig/indexes/moreover/20090115/0/_0.cfs (No such file or directory) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Concurr entMergeSchedul