ArrayIndexOutOfBoundsException errors querying MemoryIndex

2020-09-23 Thread Albert MacSweeny
Hi all, After upgrading projects from Lucene 3.0.0 to 8.5.2, I'm getting an error appearing sometimes during a load test. Caused by: java.lang.ArrayIndexOutOfBoundsException: Index -1 out of bounds for length 128 at org.apache.lucene.util.BytesRefHash$1.get(BytesRefHash.java:181) ~[luc

Re: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

2019-05-07 Thread Torben Riis
Just for keeping the mailing list up to date. I have created a JIRA issue. https://issues.apache.org/jira/browse/LUCENE-8795 Fra: Torben Riis Sendt: 7. maj 2019 11:37 Til: Michael McCandless ; Lucene Users Emne: SV: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter Hi

SV: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

2019-05-07 Thread Torben Riis
· www.multi-support.com Fra: Michael McCandless Sendt: 3. maj 2019 10:05 Til: Lucene Users ; Torben Riis Emne: Re: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter Note that the -Xint flag will make your code run tremendously more slowly! Likely to the point of not really being

Re: ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

2019-05-03 Thread Michael McCandless
in order to continue our > investigations. Hope that someone can help. :) > > > > Periodically, around once a month, we get the below > ArrayIndexOutOfBoundsException on our system. We use multiple indexes and > the error can originate from any of them, but the error always occurs in >

ArrayIndexOutOfBoundsException during System.arraycopy in BKDWriter

2019-05-01 Thread Torben Riis
Hi, I'm a bit stuck here and needs a clue or two in order to continue our investigations. Hope that someone can help. :) Periodically, around once a month, we get the below ArrayIndexOutOfBoundsException on our system. We use multiple indexes and the error can originate from any of them

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-04 Thread Tony Ma
on to corrupted index. If an index segment is already corrupted, can it be merged with another segment. Or it depends on where it got corrupted, for example corrupted in .pay file? > > > > From: 马江 > > Date: Friday, January 19, 2018 at 9:52 AM > >

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Robert Muir
or example corrupted in .pay file? > > > > From: 马江 > > Date: Friday, January 19, 2018 at 9:52 AM > > To: "java-user@lucene.apache.org" > > Subject: Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - > ArrayIndexOutOfBoundsException > > > &g

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Tony Ma
> From: 马江 > Date: Friday, January 19, 2018 at 9:52 AM > To: "java-user@lucene.apache.org" > Subject: Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException > > Hi experts, > > Still about this issue, is there

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Robert Muir
ed in .pay file? > > From: 马江 > Date: Friday, January 19, 2018 at 9:52 AM > To: "java-user@lucene.apache.org" > Subject: Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - > ArrayIndexOutOfBoundsException > > Hi experts, > > Still about this issue, is there an

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Tony Ma
e.org" Subject: Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException Hi experts, Still about this issue, is there any known bug which will cause payload file corruption? The stack trace indicates that the fisrt byte of input should be an Integer <= 32, but actua

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-01-18 Thread Tony Ma
sday, January 16, 2018 at 11:16 AM To: "java-user@lucene.apache.org" Subject: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException Hi experts, Recently one of our customer continuously seeing ArrayIndexOutOfBoundsException which is thrown from Lucene. Our prod

Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-01-15 Thread Tony Ma
Hi experts, Recently one of our customer continuously seeing ArrayIndexOutOfBoundsException which is thrown from Lucene. Our production is full-text search engine built on top of Lucene, following is the stack traces. The customer saying that they can reproduce the issue even after re-index

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

2017-09-05 Thread bebe1437
I figure out the problem, I custom an NGramFilter which takes the token's length as a default maxGramSize, and there are some documents fulled with non sense data like 'xakldjfklajsdfklajdslkf', when the token is too big to do NGramFilter , it crushed the IndexWriter. -- Sent from: http://lucen

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

2017-09-01 Thread Michael McCandless
e/LUCENE-1995 > and the other article: > http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException > -65536-td3661945.html > > I got 1M docs but it's only cost around 3-400mb, I keep the ramBufferSizeMB > as default. I'm not sure what's the problem, becaus

Re: ArrayIndexOutOfBoundsException: -65536 during full-import from old index

2017-08-31 Thread bebe1437
Updated : Some documents will throw the same exception while update with API, but the others updated with API still throw the same exception while use dataimport. -- Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html ---

ArrayIndexOutOfBoundsException: -65536 during full-import from old index

2017-08-31 Thread bebe1437
d.java:197) I checked the issue: https://issues.apache.org/jira/browse/LUCENE-1995 and the other article: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-65536-td3661945.html I got 1M docs but it's only cost around 3-400mb, I keep the ramBufferSizeMB as default. I'm

Exception in the logs from IndexUpgrader (ArrayIndexOutOfBoundsException from FixedBitSet.set)

2016-08-02 Thread Trejkaz
Hi all. Someone saw IndexUpgrader from 4.10.4 throw this when upgrading their index: Caused by: java.lang.ArrayIndexOutOfBoundsException: 191 at org.apache.lucene.util.FixedBitSet.set(FixedBitSet.java:252) at org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.ja

Re: ArrayIndexOutOfBoundsException: -65536

2014-10-15 Thread Michael McCandless
On Tue, Oct 14, 2014 at 1:29 AM, Trejkaz wrote: > Bit of thread necromancy here, but I figured it was relevant because > we get exactly the same error. Wow, blast from the past ... >> Is it possible you are indexing an absurdly enormous document...? > > We're seeing a case here where the docume

Re: ArrayIndexOutOfBoundsException: -65536

2014-10-13 Thread Trejkaz
Bit of thread necromancy here, but I figured it was relevant because we get exactly the same error. On Thu, Jan 19, 2012 at 12:47 AM, Michael McCandless wrote: > Hmm, are you certain your RAM buffer is 3 MB? > > Is it possible you are indexing an absurdly enormous document...? We're seeing a cas

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-21 Thread Matthew Petersen
Will do. I need to sanitize the unit test a bit so it might be a few days. On Fri, Jan 17, 2014 at 9:24 PM, Shai Erera wrote: > Can you open an issue and attach the test there? > On Jan 18, 2014 12:41 AM, "Matthew Petersen" wrote: > > > I do have a test that will reproduce. I'm not adding ca

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Shai Erera
Can you open an issue and attach the test there? On Jan 18, 2014 12:41 AM, "Matthew Petersen" wrote: > I do have a test that will reproduce. I'm not adding categories with very > deep hierarchies, I'm adding 129 category paths per document (all docs have > paths with same label) with each path h

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Matthew Petersen
I do have a test that will reproduce. I'm not adding categories with very deep hierarchies, I'm adding 129 category paths per document (all docs have paths with same label) with each path having one value. All of the values are completely random and likely unique. It's basically a worst case tes

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Shai Erera
Do you have a test which reproduces the error? Are you adding categories with very deep hierarchies? Shai On Fri, Jan 17, 2014 at 11:59 PM, Matthew Petersen wrote: > I've confirmed that using the LruTaxonomyWriterCache solves the issue for > me. It would appear there is in fact a bug in the Cl

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Matthew Petersen
I've confirmed that using the LruTaxonomyWriterCache solves the issue for me. It would appear there is in fact a bug in the Cl20TaxonomyWriterCache or I am using it incorrectly (I use it as default, no customization). On Fri, Jan 17, 2014 at 9:29 AM, Matthew Petersen wrote: > I'm sure. I had

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Matthew Petersen
I'm sure. I had seen that issue and it looked similar but the stack trace is slightly different. I've found that if I replace the Cl2oTaxonomyWriterCache with the LruTaxonomyWriterCache the problem seems to go away. I'm working right now on running a test that will prove this but it takes a whil

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-17 Thread Michael McCandless
Are you sure you're using 4.4? Because ... this looks like https://issues.apache.org/jira/browse/LUCENE-5048 but that was supposedly fixed in 4.4. Mike McCandless http://blog.mikemccandless.com On Thu, Jan 16, 2014 at 5:33 PM, Matthew Petersen wrote: > I’m having an issue with an index when a

Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-16 Thread Matthew Petersen
I’m having an issue with an index when adding category paths to a document. They seem to be added without issue for a long period of time, then for some unknown reason the addition fails with an ArrayIndexOutOfBounds exception. Subsequent attempts to add category paths fail with the same exceptio

ArrayIndexOutOfBoundsException calling FacteFields.addFields()

2014-01-16 Thread Matthew D. Petersen
I’m having an issue with an index when adding category paths to a document. They seem to be added without issue for a long period of time, then for some unknown reason the addition fails with an ArrayIndexOutOfBounds exception. Subsequent attempts to add category paths fail with the same excep

segment corruption - ArrayIndexOutOfBoundsException

2013-10-22 Thread Manuel Le Normand
Hello, My lucene index contains 46 segments with a total of 4M docs. Lately, while running queries I started getting seldom exceptions from this index: java.lang.ArrayIndexOutOfBoundsException at org.apache.lucene.codecs.lucene41.ForUtil.readBlock(ForUtil.java196) at org.apache.lucene.codecs.lu

Re: ArrayIndexOutOfBoundsException trying to use tokenizer in Lucene 4.1

2013-02-26 Thread Paul Taylor
On 26/02/2013 13:29, Alan Woodward wrote: Hi Paul, You need to call tokenizer.reset() before you call incrementToken() Alan Woodward www.flax.co.uk Hi, thanks that fixes it

Re: ArrayIndexOutOfBoundsException trying to use tokenizer in Lucene 4.1

2013-02-26 Thread Alan Woodward
Hi Paul, You need to call tokenizer.reset() before you call incrementToken() Alan Woodward www.flax.co.uk On 26 Feb 2013, at 12:26, Paul Taylor wrote: > This works in 3.6, but in 4.1 fails whats wrong with the code > > public void testTokenization() throws IOException >{ >StringBu

ArrayIndexOutOfBoundsException trying to use tokenizer in Lucene 4.1

2013-02-26 Thread Paul Taylor
This works in 3.6, but in 4.1 fails whats wrong with the code public void testTokenization() throws IOException { StringBuffer sb = new StringBuffer(); for(char i=0;i<100;i++) { Character c = new Character(i); if(!Character.isWhitespace(c)) {

Re: ArrayIndexOutOfBoundsException: -65536

2012-01-19 Thread Michael McCandless
IndexWriter.addDocument(IndexWriter.java:1972) >> >         ... >> >        (following are business related method stack and also had been >> > obfuscated) >> > >> > Best regards, >> > Duke >> > If not now, when? If not me, who? >> > M

Re: ArrayIndexOutOfBoundsException: -65536

2012-01-19 Thread Duke DAI
o? > > M 13818420095 > > > > > > > > On Mon, Jan 16, 2012 at 9:09 AM, Michael McCandless > > wrote: > >> > >> Do you have a full traceback of the exception? > >> > >> Mike McCandless > >> > >> http://blog.mike

Re: ArrayIndexOutOfBoundsException: -65536

2012-01-18 Thread Michael McCandless
> Best regards, > Duke > If not now, when? If not me, who? > M 13818420095 > > > > On Mon, Jan 16, 2012 at 9:09 AM, Michael McCandless > wrote: >> >> Do you have a full traceback of the exception? >> >> Mike McCandless >> >> http:/

Re: ArrayIndexOutOfBoundsException: -65536

2012-01-18 Thread Duke DAI
ou have a full traceback of the exception? > > Mike McCandless > > http://blog.mikemccandless.com > > On Sun, Jan 15, 2012 at 7:21 PM, Duke DAI wrote: > > Hi friends, > > Any one meet ArrayIndexOutOfBoundsException: -65536 described in > > https://issues.apache.org

Re: ArrayIndexOutOfBoundsException: -65536

2012-01-15 Thread Michael McCandless
Do you have a full traceback of the exception? Mike McCandless http://blog.mikemccandless.com On Sun, Jan 15, 2012 at 7:21 PM, Duke DAI wrote: > Hi friends, > Any one meet ArrayIndexOutOfBoundsException: -65536 described in > https://issues.apache.org/jira/browse/LUCENE-1995 after it

ArrayIndexOutOfBoundsException: -65536

2012-01-15 Thread Duke DAI
Hi friends, Any one meet ArrayIndexOutOfBoundsException: -65536 described in https://issues.apache.org/jira/browse/LUCENE-1995 after it declared being fixed? My lucene version is 3.0.3 and MaxRAMBufferSize is 3M. All other configurations seem to be normal. It's hard to describe the environmen

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

2010-09-24 Thread Simon Willnauer
Cool thanks! On Fri, Sep 24, 2010 at 11:07 AM, Shay Banon wrote: > Sure, opened https://issues.apache.org/jira/browse/LUCENE-2666, wanted to > ping the list first to see if someone knows about it. > > On Fri, Sep 24, 2010 at 7:12 AM, Simon Willnauer > wrote: >> >> Shay, >> >> would you mind open

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

2010-09-24 Thread Shay Banon
Sure, opened https://issues.apache.org/jira/browse/LUCENE-2666, wanted to ping the list first to see if someone knows about it. On Fri, Sep 24, 2010 at 7:12 AM, Simon Willnauer < simon.willna...@googlemail.com> wrote: > Shay, > > would you mind open a jira issue for that? > > simon > > On Fri, Se

Re: ArrayIndexOutOfBoundsException when iterating over TermDocs

2010-09-23 Thread Simon Willnauer
Shay, would you mind open a jira issue for that? simon On Fri, Sep 24, 2010 at 2:53 AM, Shay Banon wrote: > Hi, > >    A user got this very strange exception, and I managed to get the index > that it happens on. Basically, iterating over the TermDocs causes an AAOIB > exception. I easily reprod

ArrayIndexOutOfBoundsException when iterating over TermDocs

2010-09-23 Thread Shay Banon
Hi, A user got this very strange exception, and I managed to get the index that it happens on. Basically, iterating over the TermDocs causes an AAOIB exception. I easily reproduced it using the FieldCache which does exactly that (the field in question is indexed as numeric). Here is the except

Re: ArrayIndexOutOfBoundsException from TermInfosReader.get (2.3.2)

2009-04-28 Thread Michael McCandless
This doesn't ring a bell (ie sounds like something new). It's quite spooky. Any hints on what led to this? It looks like, somehow, enumOffset is that massive negative number (-1030685), in this code from TermInfosReader.java: // optimize sequential access: first try scanning cached enum w/o

ArrayIndexOutOfBoundsException from TermInfosReader.get (2.3.2)

2009-04-27 Thread Daniel Noll
Hi all. One of our users has seen an error like this: java.lang.ArrayIndexOutOfBoundsException: -1030685 at org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:210) at org.apache.lucene.index.SegmentTermDocs.seek(SegmentTermDocs.java:54) at org.apache.lucene

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-16 Thread Michael McCandless
On Wed, Apr 15, 2009 at 8:35 PM, Ryan McKinley wrote: > I have an operation that is quite expensive that I am hoping to run only > once for each time the index changes.  Is the Couldn't you simply run your expensive operation, on the IndexReader passed into getDocIdSet? Ie, just move your curre

RE: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Uwe Schindler
> >> How would I get all the doc ids with a given (stored) field from a > >> Reader? > >> I am trying: > >> > >> TermDocs td = reader.termDocs(); > > > > Relatively new in 2.9, you can pass null to enumerate over all non- > > deleted docs: > > TermDocs td = reader.termDocs(null); Or even faster:

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Ryan McKinley
thanks -- I'll move this discussion to solr-user since I am now delving into SolrIndexReader... On Apr 15, 2009, at 9:06 PM, Yonik Seeley wrote: On Wed, Apr 15, 2009 at 8:35 PM, Ryan McKinley wrote: uggg. So there is no longer a consistent docId I can use in a filter? There are ways ar

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Yonik Seeley
On Wed, Apr 15, 2009 at 8:35 PM, Ryan McKinley wrote: > uggg.  So there is no longer a consistent docId I can use in a filter? There are ways around this... I had to do something for Solr's external file field to get it to work because of these changes. We can continue this part of the discussio

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Ryan McKinley
http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Ryan McKinley [mailto:ryan...@gmail.com] Sent: Thursday, April 16, 2009 1:34 AM To: java-user@lucene.apache.org Subject: Re: BitSet Filter ArrayIndexOutOfBoundsException? Are you saying there lucene document could have

RE: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Uwe Schindler
.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Ryan McKinley [mailto:ryan...@gmail.com] > Sent: Thursday, April 16, 2009 1:34 AM > To: java-user@lucene.apache.org > Subject: Re: BitSet Filter ArrayIndexOutOfBoundsExce

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Ryan McKinley
Are you saying there lucene document could have different ids in the MultiReader and the IndexReader? I have assumed that the ids have not changed as long as the lastmodified time has not changed: long lastmodified = IndexReader.lastModified( reader.directory() ); Is this assumption correc

Re: BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Michael McCandless
Maybe it's because you're using the MultiReader docID space but getDocIdSet(IndexReader) expects you to use the docID space for that IndexReader (ie, a single segment)? Mike On Wed, Apr 15, 2009 at 1:37 PM, Ryan McKinley wrote: > I am working on a Filter that uses an RTree to test for inclusion.

BitSet Filter ArrayIndexOutOfBoundsException?

2009-04-15 Thread Ryan McKinley
I am working on a Filter that uses an RTree to test for inclusion. This Filter works great *most* of the time -- if the index is optimized, it works all of the time. I feel like I am missing something basic, but not sure what it could be. Each time the reader opens (and the index has chan

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-07 Thread Edwin Smith
ctober 7, 2008 10:43:06 AM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar Thanks for the tip. I tried your experiment and, sure enough, it works just fine, so it's not the contents but obviously some other behavior of my custom reader. (Does the analyzer require that

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-07 Thread Edwin Smith
l McCandless <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Tuesday, October 7, 2008 5:12:05 AM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar If you capture the exact text produced by the reader, and wrap it in a  StringReader and pass that to StandardAnaly

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-07 Thread Michael McCandless
don't know. Very frustrating. Ed - Original Message From: Edwin Smith <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Monday, October 6, 2008 3:20:51 PM Subject: Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar No particular reason. It is just what

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-06 Thread Edwin Smith
ified, but the text coming in from it looks correct to me, so I don't know.   Very frustrating.   Ed - Original Message From: Edwin Smith <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Monday, October 6, 2008 3:20:51 PM Subject: Re: ArrayIndexOu

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-06 Thread Edwin Smith
r 6, 2008 3:18:20 PM Subject: RE: ArrayIndexOutOfBoundsException in FastCharStream.readChar Hi Edwin, I don't know specifically what's causing the exception you're seeing, but note that in Lucene 2.3.0+, the JavaCC-generated version of StandardTokenizer (where your exception ori

RE: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-06 Thread Steven A Rowe
Hi Edwin, I don't know specifically what's causing the exception you're seeing, but note that in Lucene 2.3.0+, the JavaCC-generated version of StandardTokenizer (where your exception originates) has been replaced with a JFlex-generated version - see

ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-06 Thread Edwin Smith
I am stumped and have not seen any other reference to this problem. I am getting the following exception on everything I try to index. Does anyone know what my problem might be? Thanks, Ed java.lang.ArrayIndexOutOfBoundsException at org.apache.lucene.analysis.standard.FastCharStream.readChar(

Re: ArrayIndexOutOfBoundsException in FastCharStream.readChar

2008-10-06 Thread Edwin Smith
Oh, and in case it matters, I'm using Lucene 2.2.0. Ed - Original Message I am stumped and have not seen any other reference to this problem. I am getting the following exception on everything I try to index. Does anyone know what my problem might be? Thanks, Ed java.lang.ArrayI

bug in MultiPhraseQuery toString() method, ArrayIndexOutOfBoundsException

2008-04-30 Thread Robert . Hastings
Using Lucene 2.3.0 I'm seeing an ArrayIndexOutOfBoundsException: 0 at line 291 of MultiPhraseQuery. A test should be added for (terms.length == 0). I'm checking to see why the terms array is 0. Bob Hastings

Re: ArrayIndexOutOfBoundsException

2007-08-17 Thread Erick Erickson
Ignore the part about "much longer strings", I overlooked that this was a single term But it still works on my machine, Lucene 2.1... Erick On 8/17/07, Michael McCandless <[EMAIL PROTECTED]> wrote: > > > Hmmm ... good catch. With DocumentsWriter there is a max term length > (currently 16384

Re: ArrayIndexOutOfBoundsException

2007-08-17 Thread Erick Erickson
I've added MUCH larger strings to a document without any problem, but it was an FSDir. I admit that it is kind of "interesting" that this happens just as you cross the magic number. But I tried it on my machine and it works just fine, go figure .. Erick On 8/17/07, karl wettin <[EMAIL PROTECTED]

Re: ArrayIndexOutOfBoundsException

2007-08-17 Thread Michael McCandless
Hmmm ... good catch. With DocumentsWriter there is a max term length (currently 16384 chars). I think we should fix it to raise a clearer exception? I'll open an issue. Mike On Fri, 17 Aug 2007 19:53:09 +0200, "karl wettin" <[EMAIL PROTECTED]> said: > When I add a field containing a really lo

ArrayIndexOutOfBoundsException

2007-08-17 Thread karl wettin
When I add a field containing a really long term I get an AIOOBE. Is this a documented feature? public static void main(String[] args) throws Exception { RAMDirectory dir = new RAMDirectory(); IndexWriter iw = new IndexWriter(dir, new StandardAnalyzer (Collections.emptySet()), true);

Re: ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Rafael Rossini
Got it, I don´t have a clue if this corruption was caused by hardware failure, but that is possible because we suffer with a lot of power failures from time to time. But the thing is that I´ve been using lucene for a long time and I never got this kind of exception. The thing is that I´d l

Re: ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Yonik Seeley
On 7/24/07, Rafael Rossini <[EMAIL PROTECTED]> wrote: I did a litle debug and found that in the TermScorer, the byte[] norms has size = 1.119.933, wich is the number of docs on my index, and there is a docID = 1226511, that is if the "doc" variable in the method is the docID. I tried to access t

Re: ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Rafael Rossini
I did a litle debug and found that in the TermScorer, the byte[] norms has size = 1.119.933, wich is the number of docs on my index, and there is a docID = 1226511, that is if the "doc" variable in the method is the docID. I tried to access this document with reader.document() and got a * java.io

Re: ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Rafael Rossini
I don´t know the exact date of the build, but it is certainly before July 4, and before the LUCENE-843 patch was committed. My index has 1.119.934 docs on it and is about 8.2G. I really don´t know how to reproduce this, the only query that I get this error, so far, is "brasil"... and I don´t know

Re: ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Michael McCandless
That looks spooky. It looks like either the norms array is not large enough or that docID is too large. Do you know how many docs you have in your index? Is this easy to reproduce, maybe on a smaller index? There was a very large change recently (LUCENE-843) to speed up indexing and it's possi

ArrayIndexOutOfBoundsException on TermScorer

2007-07-24 Thread Rafael Rossini
Hello all, I´m using solr in an app, but I´m getting an error that it might be a lucene problem. When I perform a simple query like q = brasil I´m getting this exception: java.lang.ArrayIndexOutOfBoundsException: 1226511 at org.apache.lucene.search.TermScorer.score(TermScorer.java:74) at org

Re: [Spam:5.0] Re: similar ArrayIndexOutOfBoundsException on searching and optimizing

2006-05-23 Thread Patrick Kimber
e the >> frontend process uses the created index. What's puzzling is that some >> queries will die with an ArrayIndexOutOfBoundsException being thrown out >> of the BitVector class: >> >> Caused by: java.lang.ArrayIndexOutOfBoundsException: 240 >>

Re: [Spam:5.0] Re: similar ArrayIndexOutOfBoundsException on searching and optimizing

2006-05-23 Thread Adam Constabaris
emory AnalyzerUtils). The backend is responsible for index creation, updates, etc., while the frontend process uses the created index. What's puzzling is that some queries will die with an ArrayIndexOutOfBoundsException being thrown out of the BitVector class: Caused by: java.lang.ArrayIndexOutOfB

Re: similar ArrayIndexOutOfBoundsException on searching and optimizing

2006-05-23 Thread Patrick Kimber
The backend is responsible for index creation, updates, etc., while the frontend process uses the created index. What's puzzling is that some queries will die with an ArrayIndexOutOfBoundsException being thrown out of the BitVector class: Caused by: java.lang.ArrayIndexOutOfBoundsExcep

Re: ArrayIndexOutOfBoundsException w/ ImageSearcher

2006-05-04 Thread Daniel Naber
On Mittwoch 03 Mai 2006 01:46, Michael Dodson wrote: > Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: -1 This is what you get when you try to open a Lucene 1.9 index with Lucene 1.4. Regards Daniel -- http://www.danielnaber.de --

Re: ArrayIndexOutOfBoundsException w/ ImageSearcher

2006-05-03 Thread Michael Dodson
resurface later. Thanks. Mike On May 3, 2006, at 12:46 AM, Michael Dodson wrote: Hi, I'm getting an ArrayIndexOutOfBoundsException when I try to create an instance of IndexSearcher with an FSDirectory. for IndexSearcher searcher = new IndexSearcher(directory); I get the following stack

ArrayIndexOutOfBoundsException w/ ImageSearcher

2006-05-02 Thread Michael Dodson
Hi, I'm getting an ArrayIndexOutOfBoundsException when I try to create an instance of IndexSearcher with an FSDirectory. for IndexSearcher searcher = new IndexSearcher(directory); I get the following stack trace: Exception in thread "main" java.lang.ArrayIndexOutOfBoun

similar ArrayIndexOutOfBoundsException on searching and optimizing

2006-04-21 Thread Adam Constabaris
ill die with an ArrayIndexOutOfBoundsException being thrown out of the BitVector class: Caused by: java.lang.ArrayIndexOutOfBoundsException: 240 at org.apache.lucene.util.BitVector.get(BitVector.java:63) at org.apache.lucene.index.SegmentTermDocs.read(SegmentTermDocs.java:1

RE: ArrayIndexOutOfBoundsException being thrown ...

2006-02-22 Thread Mufaddal Khumri
I switched back to lucene-1.4.3.jar and i dont get the exception any more? Is this a bug in the new jar? -Mufaddal. -Original Message- From: Mufaddal Khumri [mailto:[EMAIL PROTECTED] Sent: Wed 2/22/2006 10:20 AM To: java-user@lucene.apache.org Subject: ArrayIndexOutOfBoundsException

ArrayIndexOutOfBoundsException being thrown ...

2006-02-22 Thread Mufaddal Khumri
Getting an ArrayIndexOutOfBoundsException ... Line 31 in IndexSearcherManager.java: ... public static IndexSearcher getIndexSearcher(String indexPath) { logger.debug("indexPath = " + indexPath);

Re: ArrayIndexOutOfBoundsException while closing the index writer

2006-02-17 Thread Otis Gospodnetic
rsday, February 16, 2006 12:32:40 AM Subject: RE: ArrayIndexOutOfBoundsException while closing the index writer Hi Otis, Thanks for such a quick reply. I tried using finally, but it didn't help. I guess if I explain the integration of lucene with my app in little detail then you probably ca

RE: ArrayIndexOutOfBoundsException while closing the index writer

2006-02-15 Thread Shivani Sawhney
ilto:[EMAIL PROTECTED] Sent: 16 February, 2006 10:16 AM To: java-user@lucene.apache.org Subject: Re: ArrayIndexOutOfBoundsException while closing the index writer Who knows what else the app is doing. However, I can quickly suggest that you add a finally block and close your writer in there if

ArrayIndexOutOfBoundsException while closing the index writer

2006-02-15 Thread Shivani Sawhney
Hi, I have used Lucene in my application and am just indexing and searching on some documents. The code that indexes the documents was working fine till yesterday and suddenly stopped working. I get an error when I am trying to close the index writer. The code is as follows: .

Re: ArrayIndexOutOfBoundsException while closing the index writer

2006-02-15 Thread Otis Gospodnetic
11:31:12 PM Subject: ArrayIndexOutOfBoundsException while closing the index writer Hi, I have used Lucene in my application and am just indexing and searching on some documents. The code that indexes the documents was working fine till yesterday and suddenly stopped working. I get an error whe

Highlighter ArrayIndexOutOfBoundsException - W/Fix

2005-06-01 Thread Andrew Boyd
Hi, I'm getting an ArrayIndexOutOfBoundsException within the highlighter: java.lang.ArrayIndexOutOfBoundsException: 50 at org.apache.lucene.search.highlight.TokenGroup.addToken(TokenGroup.java:47) at org.apache.lucene.search.highlight.Highlighter.getBestDocFragments(Highlighter

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-08 Thread Matt Magoffin
> It took some sleep to realize this: > This exception can happen when a scorer is add()'ed to the BooleanScorer > after > the query search has begun. Given that it is difficult to reproduce, the > odds > are that there two threads not properly synchronized: one add()ing > to the BooleanScorer and

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-07 Thread Paul Elschot
Matt, On Thursday 05 May 2005 21:26, Matt Magoffin wrote: > Hello, I'm having a tough time trying to get to the root of an exception I > see sometimes on my Lucene 1.4.3 index. The exception is: > > java.lang.ArrayIndexOutOfBoundsException: 4 > at org.apache.lucene.search.BooleanScorer.score(Boo

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-06 Thread Paul Elschot
On Friday 06 May 2005 18:19, Matt Magoffin wrote: > Here is a sample query that produces the error: > > +dcode:123182 +cdate:[20050501 TO 20050531] +((+gn:m +sn:malen) > phone:3458345730 addr:345 hiller (+sn:malen +zip:34535)) From the earlier posted tracebacs, the problem is probably due to this

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-06 Thread Matt Magoffin
Here is a sample query that produces the error: +dcode:123182 +cdate:[20050501 TO 20050531] +((+gn:m +sn:malen) phone:3458345730 addr:345 hiller (+sn:malen +zip:34535)) I'll see about getting a test case, but like I said it doesn't happen every time so I've had a hard time tracking down the probl

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-06 Thread Paul Elschot
On Thursday 05 May 2005 21:45, Matt Magoffin wrote: > The exception does come on the heels of an update to the index by a > different thread than the one the search runs in. These log statements > show the operations going on just prior to the exception: > > May-05 12:36:05 DEBUG - Indexing Lead 1

Re: ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-05 Thread Matt Magoffin
The exception does come on the heels of an update to the index by a different thread than the one the search runs in. These log statements show the operations going on just prior to the exception: May-05 12:36:05 DEBUG - Indexing Lead 1024 May-05 12:36:06 TRACE - CON Closing IndexWriter [EMAIL PRO

ArrayIndexOutOfBoundsException on BooleanScorer.score()

2005-05-05 Thread Matt Magoffin
Hello, I'm having a tough time trying to get to the root of an exception I see sometimes on my Lucene 1.4.3 index. The exception is: java.lang.ArrayIndexOutOfBoundsException: 4 at org.apache.lucene.search.BooleanScorer.score(BooleanScorer.java:126) at org.apache.lucene.search.Scorer.score(Scorer

Re: Webapp Demo throws ArrayIndexOutOfBoundsException on Large index

2005-03-11 Thread Chris D
On Fri, 11 Mar 2005 16:47:50 +0100, Daniel Naber <[EMAIL PROTECTED]> wrote: > On Friday 11 March 2005 16:35, Chris D wrote: > > > Is there an issue with Tomcat and large indexes? Should I be looking > > elsewhere for a solution? > > Are you sure tomcat uses the same lucene.jar as your standalone

Re: Webapp Demo throws ArrayIndexOutOfBoundsException on Large index

2005-03-11 Thread Daniel Naber
On Friday 11 March 2005 16:35, Chris D wrote: >  Is there an issue with Tomcat and large indexes? Should I be looking > elsewhere for a solution? Are you sure tomcat uses the same lucene.jar as your standalone test does? Regards Daniel --

Re: Webapp Demo throws ArrayIndexOutOfBoundsException on Large index

2005-03-11 Thread Chris D
to search the second I get a > "ArrayIndexOutOfBoundsException": > > java.lang.ArrayIndexOutOfBoundsException: -1 > at java.util.ArrayList.get(ArrayList.java:324) > at org.apache.lucene.index.FieldInfos.fieldInfo(FieldInfos.java:155) > at org.apache.lucene.index.

Webapp Demo throws ArrayIndexOutOfBoundsException on Large index

2005-03-08 Thread Chris D
I've been playing with the webapp and attempting to search over two indexes that I've created. The first was 700M the second is 2.3G. When the webapp attempts to search the second I get a "ArrayIndexOutOfBoundsException": java.lang.ArrayIndexOutOfBoundsException: -1 at jav