Re: Is Analyzer used when calling IndexWriter.addIndexesNoOptimize()?

2012-12-05 Thread Earl Hood
On Wed, Dec 5, 2012 at 8:24 AM, Jack Krupansky wrote: > These are operations on indexes, so analysis is no longer relevant. Analysis > is performed BEFORE data is placed in an index. You still need to perform > analysis for queries though. This is what I thought. Just wanted to get confirmation.

RE: CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Uwe Schindler
And also check, that you don't have -XX:+AggressiveOpts in your JVM options!... http://blog.thetaphi.de/2011/07/real-story-behind-java-7-ga-bugs.html I just wanted to remember, because many more of those bugs are definitely enabled with aggressive optimizations in earlier JDK6! - Uwe Schind

Re: CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Robert Muir
On Wed, Dec 5, 2012 at 2:27 PM, Tom Burton-West wrote: > Thanks Robert, > > I've asked our sysadmins to install a more recent Java version for testing. > I'll report back if it fails with the newer Java version. > Please let us know either way!

Re: CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Tom Burton-West
Thanks Robert, I've asked our sysadmins to install a more recent Java version for testing. I'll report back if it fails with the newer Java version. Tom On Wed, Dec 5, 2012 at 4:53 PM, Robert Muir wrote: > I'm particularly thinking its something like > http://bugs.sun.com/bugdatabase/view_bu

Re: CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Robert Muir
I'm particularly thinking its something like http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=5091921 We tried to add workarounds to lucene to dodge problems from this, but really a newer unaffected version would be safer. On Wed, Dec 5, 2012 at 1:47 PM, Robert Muir wrote: > > On Wed, Dec 5,

Re: CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Robert Muir
On Wed, Dec 5, 2012 at 1:30 PM, Tom Burton-West wrote: > java.version=1.6.0_16 Tom can you use a newer java version for this? That's pretty old, and seeing such a crazy field number worries me that its some jvm bug. you could even try to run the checkindex itself with a newer java, just in cas

CheckIndex ArrayIndexOutOfBounds error for merged index

2012-12-05 Thread Tom Burton-West
Hello, I'm trying to merge 12 indexed into one big index using the Lucene IndexMergeTool (command line used appended below). The merge seemed to finish successfully, but when I ran CheckIndex on the merged index, I got an array out of bounds error "java.lang.ArrayIndexOutOfBoundsException: 13315

Re: Is Analyzer used when calling IndexWriter.addIndexesNoOptimize()?

2012-12-05 Thread Jack Krupansky
These are operations on indexes, so analysis is no longer relevant. Analysis is performed BEFORE data is placed in an index. You still need to perform analysis for queries though. You can use different analyzers as long as they are compatible - if they produce the same results, but if they don

Re: Beginning with Lucene

2012-12-05 Thread Mohammad Tariq
Thank you for the tip Ian. Regards, Mohammad Tariq On Wed, Dec 5, 2012 at 3:10 PM, Ian Lea wrote: > Read Lucene in Action. The fundamental concepts and techniques haven't > changed. You can keep a copy of the release notes and migration > guides for later versions to hand. > > > -- > Ian

Re: Beginning with Lucene

2012-12-05 Thread Ian Lea
Read Lucene in Action. The fundamental concepts and techniques haven't changed. You can keep a copy of the release notes and migration guides for later versions to hand. -- Ian. On Wed, Dec 5, 2012 at 12:55 AM, Mohammad Tariq wrote: > Sorry to be a pest of question guys. But, I need some more