Lucene Indexing

2011-06-06 Thread Pranav goyal
Hi all, Got stuck at a place and not able to think what should I do. I have one structure which I have to index. Let say the structure name is Contract which has a unique Contract_ID. Let say I have 50 contracts which I have to index. Now each contract has let say 100 different keys with their va

When nested indexing and search will be available?

2011-06-06 Thread zhoucheng2008
I just saw this: https://issues.apache.org/jira/secure/attachment/12480123/LUCENE-2454.patch One comment: should Lucene provide nested doc indexing as well? Would love to see it’s available. - To unsubscribe, e-mail: ja

Re: When nested indexing and search will be available?

2011-06-06 Thread Mark Harwood
As of 3.2 the necessary changes were put in to safely support indexing nested docs. See http://lucene.apache.org/java/3_2_0/changes/Changes.html#3.2.0.new_features On 6 Jun 2011, at 17:18, 周诚 wrote: > I just saw this: > https://issues.apache.org/jira/secure/attachment/12480123/LUCENE-2454.patc

When nested indexing and search will be available?

2011-06-06 Thread 周诚
I just saw this: https://issues.apache.org/jira/secure/attachment/12480123/LUCENE-2454.patch One comment: should Lucene provide nested doc indexing as well? Would love to see it’s available.

RE: RAMDirectory doesn't win over FSDirectory all the time, why?

2011-06-06 Thread zhoucheng2008
I did run it on a 64bit win7 and use Lucene 3.0.3. The result that FSD outperforms RAM in this case seems to be consistent as I ran a bunch of tests. My wild guess is that FSD can leverage the MMapDirectory advantage as well as the three tuning parameters. Just a thought. -Original Message-

RE: RAMDirectory doesn't win over FSDirectory all the time, why?

2011-06-06 Thread Uwe Schindler
Hi, It depends on the Lucene version, so if the test uses latest Lucene on a 64bit OS, it may use MMapDirectory internally (returned on FSDirectors.open()) - then its comparing the same with the same - reading from ram memory :-) Maybe the difference is also caused by not warming hotspot's compil

Re: RAMDirectory doesn't win over FSDirectory all the time, why?

2011-06-06 Thread Michael McCandless
This test is very old (from the 1st edition of the book but removed from the 2nd). Modern OS's cache newly written files in RAM, and this test doesn't write very large files (I think?), so the test is really testing an OS's IO cache vs Lucene's RAM Dir. That said, I'm not sure why RAMDir would be

Re: IndexNotFoundException

2011-06-06 Thread Ben Hood
Ian, Thanks a lot for the heads up. I didn't even know those detailed release notes existed - I just looked on the main release page and searched a bit through JIRA. Cheers, Ben On Mon, Jun 6, 2011 at 2:57 PM, Ian Lea wrote: > In the release notes for 3.1.0 under Changes in backwards > compati

Possible Bug when add wildcard to search following an exclamation mark

2011-06-06 Thread Paul Taylor
If I do a search which consists of escaped ending exclamation marks it all works okay: (ahhh\!\!\!) and find the desired match but if there is a wildcard at the end, it will not find any matches (ahhh\!\!\!*) I cant see Im doing anything in my code that would affect this, is this a bu

Re: IndexNotFoundException

2011-06-06 Thread Ian Lea
In the release notes for 3.1.0 under Changes in backwards compatibility policy it says LUCENE-2386: IndexWriter no longer performs an empty commit upon new index creation. Previously, if you passed an empty Directory and set OpenMode to CREATE*, IndexWriter would make a first empty commit. If you

RAMDirectory doesn't win over FSDirectory all the time, why?

2011-06-06 Thread zhoucheng2008
I read the lucene in action book and just tested the FSversusRAMDirectoryTest.java with the following uncommented: ///** //// change to adjust performance of indexing with FSDirectory writer.mergeFactor = 100; writer.maxMergeDocs = 99; writer.minM

Re: Lucene Indexing

2011-06-06 Thread Anshum
Yes, You'd need to delete the document and then re-add a newly created document object. You may use the key and delete the doc using the Term(key, value). -- Anshum Gupta http://ai-cafe.blogspot.com On Mon, Jun 6, 2011 at 4:45 PM, Pranav goyal wrote: > Hi Anshum, > > Thanks for answering my que

Re: Lucene Document No

2011-06-06 Thread Anshum
Hi Pranav, Why would you want to do that in the first place? You could use a separate field to process whatever it is that you're trying to do. Also, you can not change the docid (as there's no reasonable reason for doing so either). Let me know what is it that you're trying to achieve/target. --

Re: Lucene Indexing

2011-06-06 Thread Pranav goyal
Hi Anshum, Thanks for answering my question. By this I got to know that I cannot update without deleting my document. So whenever I am indexing the documents first I need to check whether the particular key exists in the document or not and if it exists I need to delete it and add the updated one

Lucene Document No

2011-06-06 Thread Pranav goyal
Hi all, Is there any way to change my lucene document no? Like if I can change my lucene document no's with con_key. I am a newbie and don't know whether this is a silly question or not. Please reply. Thanks

Re: Lucene Indexing

2011-06-06 Thread Anshum
Hii Pranav, By what you've mentioned, it looks like you want to modify a particular document (or all docs) by adding a particular field in the document(s). As of right now, its not possible to modify a document inside a lucene index. That is due to the way the index is structured. The only way as

Re: IndexNotFoundException

2011-06-06 Thread Ben Hood
For note, this code works with 3.0.3: package net.lshift.diffa.kernel.util; import com.eaio.uuid.UUID; import org.apache.lucene.analysis.standard.StandardAnalyzer; import org.apache.lucene.index.IndexWriter; import org.apache.lucene.search.IndexSearcher; import org.apache.lucene.store.FSDirectory

IndexNotFoundException

2011-06-06 Thread Ben Hood
Hi, I'm trying to upgrade from 3.0.2 to 3.2.0 and am running into the following issue when trying to boot an IndexSearcher: Exception in thread "main" org.apache.lucene.index.IndexNotFoundException: no segments* file found in org.apache.lucene.store.NIOFSDirectory@/tmp/804f7160-9023-11e0-9123-00

Travel Assistance applications now open for ApacheCon NA 2011

2011-06-06 Thread Simon Willnauer
The Apache Software Foundation (ASF)'s Travel Assistance Committee (TAC) is now accepting applications for ApacheCon North America 2011, 7-11 November in Vancouver BC, Canada. The TAC is seeking individuals from the Apache community at-large --users, developers, educators, students, Committers, an

Re: Federated relevance ranking

2011-06-06 Thread Toke Eskildsen
On Thu, 2011-06-02 at 21:51 +0200, Clint Gilbert wrote: > We're also considering a home-grown scheme involving normalizing the > denominators of all the index components in all our indices, based on > the sums of counts obtained from all the indices. This feels like > re-inventing the wheel, and i