Getting RuntimeException: after flush: fdx size mismatch while Indexing

2011-12-08 Thread Jamir Shaikh
I am using Lucene 3.5. I want to create around 30 million documents. While doing Indexing I am getting the following Exception: Caused by: java.lang.RuntimeException: after flush: fdx size mismatch: 7442 docs vs 32768 length in bytes of _ct.fdx file exists?=true at org.apache.luce

how to do remote debug on benchmark test or whatever test?

2011-12-08 Thread hao yan
Which file should i go and set: -Xdebug -Xrunjdwp:transport=dt_socket,address=8886,server=y,suspend=y ? thanks! hao - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h.

Re: Lucene 4.0 Index Format Finalization Timetable

2011-12-08 Thread Mark Miller
While we are in constant sync due to the merge, lucene would still be updated multiple times before a solr 4 release, and it would be subject to happen at any time - so its really not any different. On Wednesday, December 7, 2011, Jamie Johnson wrote: > Yeah, biggest issue for us is we're using t

Re: Split mutable logical document into two Lucene documents

2011-12-08 Thread Brandon Mintern
Thank you for the pointer. I looked into nested documents, but it appears that the implementation relies on each parent document being indexed immediately before all of its children. Unfortunately, this presents two problems: 1. Any optimize operation will break nesting 2. Deleting and reindexing

Re: Lucene 4.0 MemoryIndex Bug?

2011-12-08 Thread Robert Muir
anytime you see nosuchmethoderror, it means its a bug in your configuration (wrong, out of date classes/jar files) On Thu, Dec 8, 2011 at 3:55 PM, Stephen Howe wrote: > I've been playing around with Lucene's MemoryIndex and anytime I try to use > index.addField(String, String, Analyzer), I > rece

Re: Lucene 4.0 MemoryIndex Bug?

2011-12-08 Thread Uwe Schindler
Hi, You mixed incompatible jar file versions of Lucene 4.0 modules. Try to recompile everything from source. Uwe -- Uwe Schindler H.-H.-Meier-Allee 63, 28213 Bremen http://www.thetaphi.de Stephen Howe schrieb: I've been playing around with Lucene's MemoryIndex and anytime I try to use index

Lucene 4.0 MemoryIndex Bug?

2011-12-08 Thread Stephen Howe
I've been playing around with Lucene's MemoryIndex and anytime I try to use index.addField(String, String, Analyzer), I receive: java.lang.NoSuchMethodError: org.apache.lucene.util.BytesRef.deepCopyOf(Lorg/apache/lucene/util/BytesRef;)Lorg/apache/lucene/util/BytesRef; anytime I make a call to it. I

Re: SpanNearQuery and matching spans inside the first span

2011-12-08 Thread Ian Lea
Have you read http://www.lucidimagination.com/blog/2009/07/18/the-spanquery/? Might help explain some of the behaviour you are seeing. -- Ian. On Tue, Dec 6, 2011 at 4:42 AM, Trejkaz wrote: > Supposing I have a document with just "hi there" as the text. > > If I do a span query like this: > >

Re: Split mutable logical document into two Lucene documents

2011-12-08 Thread Ian Lea
It is conceivable that nested documents might help. https://issues.apache.org/jira/browse/LUCENE-2454. I don't know anything about that so might be way off target. -- Ian. On Wed, Dec 7, 2011 at 8:46 PM, Brandon Mintern wrote: > We have a document tagging system where documents are composed o

RE: Score per position

2011-12-08 Thread Zhang, Lisheng
Hi, A few days ago I asked a similar question: 1) in coming lucene 4.0, there is a feature sort like payload in document level: >lucene 4 has a feature called IndexDocValues which is essentially a > payload per document per field. > > you can read about it here: > http://www.searchworkings.org/b

Re: Improving Lucene Search Performance

2011-12-08 Thread Ian Lea
See http://wiki.apache.org/lucene-java/ImproveSearchingSpeed. Some of the tips relate to indexing but most to search time stuff. -- Ian. On Thu, Dec 8, 2011 at 10:45 AM, Dilshad K. P. wrote: > Hi, > Is there any thing to take care while creating index for improving lucene > text search speed

Re: Spell check on a subset of an index ( 'namespace' aware spell checker)

2011-12-08 Thread E. van Chastelet
Ian, thank you for your suggestions. I have looked to the TermEnum and TermDocs, but they don't offer a combination with terms and frequencies (used by our autocompleter class) from a filtered set of docs. Eventually I implemented the following solution: - In the source index, get all terms f

Improving Lucene Search Performance

2011-12-08 Thread Dilshad K. P.
Hi, Is there any thing to take care while creating index for improving lucene text search speed. Thanks And Regards Dilshad K.P * Confidentiality Statement/Disclaimer * This message and any attachments is intended for the sole use of the intended recipient. It may contain confidential i