Re: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

-support.com<http://www.multi-support.com> Fra: Michael McCandless mailto:luc...@mikemccandless.com>> Sendt: 3. maj 2019 10:05 Til: Lucene Users mailto:java-user@lucene.apache.org>>; Torben Riis mailto:t...@multi-support.com>> Emne: Re: ArrayIndexOutOfBoundsException du

Re: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

Note that the -Xint flag will make your code run tremendously more slowly! Likely to the point of not really being usable. But it'd be interesting to see if that side-steps the bug. Is it possible to test with OpenJDK as well? The BKDWriter code is quite complex, so it is also possible there i

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

I figure out the problem, I custom an NGramFilter which takes the token's length as a default maxGramSize, and there are some documents fulled with non sense data like 'xakldjfklajsdfklajdslkf', when the token is too big to do NGramFilter , it crushed the IndexWriter. -- Sent from: http://lucen

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

Is it possible that exception is thrown when trying to index an extremely large document? Mike McCandless http://blog.mikemccandless.com On Fri, Sep 1, 2017 at 12:07 AM, bebe1437 wrote: > My solr version is 5.5.4, > I set docValues="true" to some old fields, > and I use dataimport to reindex,

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

Updated : Some documents will throw the same exception while update with API, but the others updated with API still throw the same exception while use dataimport. -- Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html ---

Re: ArrayIndexOutOfBoundsException: -65536

On Tue, Oct 14, 2014 at 1:29 AM, Trejkaz wrote: > Bit of thread necromancy here, but I figured it was relevant because > we get exactly the same error. Wow, blast from the past ... >> Is it possible you are indexing an absurdly enormous document...? > > We're seeing a case here where the docume

Re: ArrayIndexOutOfBoundsException: -65536

Bit of thread necromancy here, but I figured it was relevant because we get exactly the same error. On Thu, Jan 19, 2012 at 12:47 AM, Michael McCandless wrote: > Hmm, are you certain your RAM buffer is 3 MB? > > Is it possible you are indexing an absurdly enormous document...? We're seeing a cas

Re: ArrayIndexOutOfBoundsException trying to use tokenizer in Lucene 4.1

On 26/02/2013 13:29, Alan Woodward wrote: Hi Paul, You need to call tokenizer.reset() before you call incrementToken() Alan Woodward www.flax.co.uk Hi, thanks that fixes it

Re: ArrayIndexOutOfBoundsException trying to use tokenizer in Lucene 4.1

Hi Paul, You need to call tokenizer.reset() before you call incrementToken() Alan Woodward www.flax.co.uk On 26 Feb 2013, at 12:26, Paul Taylor wrote: > This works in 3.6, but in 4.1 fails whats wrong with the code > > public void testTokenization() throws IOException >{ >StringBu

Re: ArrayIndexOutOfBoundsException: -65536

Bad RAM could in theory lead to this, for example. But I would triple check your RAM buffer size and the actual size of the document being indexed. For example, if the RAM buffer size is small (3 MB) but the document is very large (eg maybe 500+ MB), or has many many unique terms and is fairly la

Re: ArrayIndexOutOfBoundsException: -65536

Dear Mike, Yes, it's possible that the document is bigger enough after original PDF has been processed to intermediate one. I'm trying to make sure it from customer. I can't produce with the same PDF on in-house system, but the component translating PDF to intermediate file can be different. What

Re: ArrayIndexOutOfBoundsException: -65536

Hmm, are you certain your RAM buffer is 3 MB? Is it possible you are indexing an absurdly enormous document...? Finally, it's possible this is a hardware issue; does it happen on other machines? Mike McCandless http://blog.mikemccandless.com On Wed, Jan 18, 2012 at 8:15 AM, Duke DAI wrote: >

Re: ArrayIndexOutOfBoundsException: -65536

Dear Mike, Thank you very much and sorry for the late reply. Followings are the trace stack, the lucene code line is 3.0.3. From line numbers, lucene is adding payload field to the buffer. This had been tested millions of times in various customers and internally. But recently the exception happen

Re: ArrayIndexOutOfBoundsException: -65536

Do you have a full traceback of the exception? Mike McCandless http://blog.mikemccandless.com On Sun, Jan 15, 2012 at 7:21 PM, Duke DAI wrote: > Hi friends, > Any one meet ArrayIndexOutOfBoundsException: -65536 described in > https://issues.apache.org/jira/browse/LUCENE-1995 after it declared b

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

Cool thanks! On Fri, Sep 24, 2010 at 11:07 AM, Shay Banon wrote: > Sure, opened https://issues.apache.org/jira/browse/LUCENE-2666, wanted to > ping the list first to see if someone knows about it. > > On Fri, Sep 24, 2010 at 7:12 AM, Simon Willnauer > wrote: >> >> Shay, >> >> would you mind open

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

Sure, opened https://issues.apache.org/jira/browse/LUCENE-2666, wanted to ping the list first to see if someone knows about it. On Fri, Sep 24, 2010 at 7:12 AM, Simon Willnauer < simon.willna...@googlemail.com> wrote: > Shay, > > would you mind open a jira issue for that? > > simon > > On Fri, Se

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

Shay, would you mind open a jira issue for that? simon On Fri, Sep 24, 2010 at 2:53 AM, Shay Banon wrote: > Hi, > >    A user got this very strange exception, and I managed to get the index > that it happens on. Basically, iterating over the TermDocs causes an AAOIB > exception. I easily reprod

Re: ArrayIndexOutOfBoundsException from TermInfosReader.get (2.3.2)

This doesn't ring a bell (ie sounds like something new). It's quite spooky. Any hints on what led to this? It looks like, somehow, enumOffset is that massive negative number (-1030685), in this code from TermInfosReader.java: // optimize sequential access: first try scanning cached enum w/o

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

ctober 7, 2008 10:43:06 AM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar Thanks for the tip. I tried your experiment and, sure enough, it works just fine, so it's not the contents but obviously some other behavior of my custom reader. (Does the analyzer require that

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

l McCandless <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Tuesday, October 7, 2008 5:12:05 AM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar If you capture the exact text produced by the reader, and wrap it in a  StringReader and pass that to StandardAnaly

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

don't know. Very frustrating. Ed - Original Message From: Edwin Smith <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Monday, October 6, 2008 3:20:51 PM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar No particular reason. It is just what

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

ified, but the text coming in from it looks correct to me, so I don't know.   Very frustrating.   Ed - Original Message From: Edwin Smith <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Monday, October 6, 2008 3:20:51 PM Subject: Re: ArrayIndexOu

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

r 6, 2008 3:18:20 PM Subject: RE: ArrayIndexOutOfBoundsException in FastCharStream.readChar Hi Edwin, I don't know specifically what's causing the exception you're seeing, but note that in Lucene 2.3.0+, the JavaCC-generated version of StandardTokenizer (where your exception ori

RE: ArrayIndexOutOfBoundsException in FastCharStream.readChar

Hi Edwin, I don't know specifically what's causing the exception you're seeing, but note that in Lucene 2.3.0+, the JavaCC-generated version of StandardTokenizer (where your exception originates) has been replaced with a JFlex-generated version - see

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

Oh, and in case it matters, I'm using Lucene 2.2.0. Ed - Original Message I am stumped and have not seen any other reference to this problem. I am getting the following exception on everything I try to index. Does anyone know what my problem might be? Thanks, Ed java.lang.ArrayI

Re: ArrayIndexOutOfBoundsException

Ignore the part about "much longer strings", I overlooked that this was a single term But it still works on my machine, Lucene 2.1... Erick On 8/17/07, Michael McCandless <[EMAIL PROTECTED]> wrote: > > > Hmmm ... good catch. With DocumentsWriter there is a max term length > (currently 16384

Re: ArrayIndexOutOfBoundsException

I've added MUCH larger strings to a document without any problem, but it was an FSDir. I admit that it is kind of "interesting" that this happens just as you cross the magic number. But I tried it on my machine and it works just fine, go figure .. Erick On 8/17/07, karl wettin <[EMAIL PROTECTED]

Re: ArrayIndexOutOfBoundsException

Hmmm ... good catch. With DocumentsWriter there is a max term length (currently 16384 chars). I think we should fix it to raise a clearer exception? I'll open an issue. Mike On Fri, 17 Aug 2007 19:53:09 +0200, "karl wettin" <[EMAIL PROTECTED]> said: > When I add a field containing a really lo

Re: ArrayIndexOutOfBoundsException on TermScorer

Got it, I don´t have a clue if this corruption was caused by hardware failure, but that is possible because we suffer with a lot of power failures from time to time. But the thing is that I´ve been using lucene for a long time and I never got this kind of exception. The thing is that I´d l

Re: ArrayIndexOutOfBoundsException on TermScorer

On 7/24/07, Rafael Rossini <[EMAIL PROTECTED]> wrote: I did a litle debug and found that in the TermScorer, the byte[] norms has size = 1.119.933, wich is the number of docs on my index, and there is a docID = 1226511, that is if the "doc" variable in the method is the docID. I tried to access t

Re: ArrayIndexOutOfBoundsException on TermScorer

I did a litle debug and found that in the TermScorer, the byte[] norms has size = 1.119.933, wich is the number of docs on my index, and there is a docID = 1226511, that is if the "doc" variable in the method is the docID. I tried to access this document with reader.document() and got a * java.io

Re: ArrayIndexOutOfBoundsException on TermScorer

I don´t know the exact date of the build, but it is certainly before July 4, and before the LUCENE-843 patch was committed. My index has 1.119.934 docs on it and is about 8.2G. I really don´t know how to reproduce this, the only query that I get this error, so far, is "brasil"... and I don´t know

Re: ArrayIndexOutOfBoundsException on TermScorer

That looks spooky. It looks like either the norms array is not large enough or that docID is too large. Do you know how many docs you have in your index? Is this easy to reproduce, maybe on a smaller index? There was a very large change recently (LUCENE-843) to speed up indexing and it's possi

Re: ArrayIndexOutOfBoundsException w/ ImageSearcher

On Mittwoch 03 Mai 2006 01:46, Michael Dodson wrote: > Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: -1 This is what you get when you try to open a Lucene 1.9 index with Lucene 1.4. Regards Daniel -- http://www.danielnaber.de --

Re: ArrayIndexOutOfBoundsException w/ ImageSearcher

I think I've fixed my own problem. I was using 1.4.3 in my code and the index was using 1.9.1. I updated and no longer get the error. Is this consistent with other people's experience though? I want to make sure this was actually the problem so the error doesn't resurface later. Thank

RE: ArrayIndexOutOfBoundsException being thrown ...

I switched back to lucene-1.4.3.jar and i dont get the exception any more? Is this a bug in the new jar? -Mufaddal. -Original Message- From: Mufaddal Khumri [mailto:[EMAIL PROTECTED] Sent: Wed 2/22/2006 10:20 AM To: java-user@lucene.apache.org Subject: ArrayIndexOutOfBoundsException bei

Re: ArrayIndexOutOfBoundsException while closing the index writer

rsday, February 16, 2006 12:32:40 AM Subject: RE: ArrayIndexOutOfBoundsException while closing the index writer Hi Otis, Thanks for such a quick reply. I tried using finally, but it didn't help. I guess if I explain the integration of lucene with my app in little detail then you probably ca

RE: ArrayIndexOutOfBoundsException while closing the index writer

ilto:[EMAIL PROTECTED] Sent: 16 February, 2006 10:16 AM To: java-user@lucene.apache.org Subject: Re: ArrayIndexOutOfBoundsException while closing the index writer Who knows what else the app is doing. However, I can quickly suggest that you add a finally block and close your writer in there if

Re: ArrayIndexOutOfBoundsException while closing the index writer

Who knows what else the app is doing. However, I can quickly suggest that you add a finally block and close your writer in there if writer != null. Otis - Original Message From: Shivani Sawhney <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Wednesday, February 15, 2006 11:31:

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

> It took some sleep to realize this: > This exception can happen when a scorer is add()'ed to the BooleanScorer > after > the query search has begun. Given that it is difficult to reproduce, the > odds > are that there two threads not properly synchronized: one add()ing > to the BooleanScorer and

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

Matt, On Thursday 05 May 2005 21:26, Matt Magoffin wrote: > Hello, I'm having a tough time trying to get to the root of an exception I > see sometimes on my Lucene 1.4.3 index. The exception is: > > java.lang.ArrayIndexOutOfBoundsException: 4 > at org.apache.lucene.search.BooleanScorer.score(Boo

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

On Friday 06 May 2005 18:19, Matt Magoffin wrote: > Here is a sample query that produces the error: > > +dcode:123182 +cdate:[20050501 TO 20050531] +((+gn:m +sn:malen) > phone:3458345730 addr:345 hiller (+sn:malen +zip:34535)) From the earlier posted tracebacs, the problem is probably due to this

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

Here is a sample query that produces the error: +dcode:123182 +cdate:[20050501 TO 20050531] +((+gn:m +sn:malen) phone:3458345730 addr:345 hiller (+sn:malen +zip:34535)) I'll see about getting a test case, but like I said it doesn't happen every time so I've had a hard time tracking down the probl

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

On Thursday 05 May 2005 21:45, Matt Magoffin wrote: > The exception does come on the heels of an update to the index by a > different thread than the one the search runs in. These log statements > show the operations going on just prior to the exception: > > May-05 12:36:05 DEBUG - Indexing Lead 1

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

The exception does come on the heels of an update to the index by a different thread than the one the search runs in. These log statements show the operations going on just prior to the exception: May-05 12:36:05 DEBUG - Indexing Lead 1024 May-05 12:36:06 TRACE - CON Closing IndexWriter [EMAIL PRO