Re: make data search as index progress.

2014-05-02 Thread Jason Wee
Hello Jose, Well, yes, we are using append but if during indexing, you did not commit and only when the index is done, that is it close, then the index will persist. But other than that, during indexing, if commit is not perform, then during that duration, all index is lost. Yes, we are trying dif

Re: make data search as index progress.

2014-04-15 Thread Jose Carlos Canova
No, the index remains, you can reopen using OpenMode.Append (an enum somewhere) if there is any exception like power loss you must delete the lock file(which lock the index stream for other index process), i solved some issues on performance using a multithread task since the IndexWriter is thread

Re: make data search as index progress.

2014-04-15 Thread Jason Wee
Hello Jose, Thank you for your insight. It sounds to me that, before method commit is called, then if there is any error happened, example, power failure or human error, then the index will be lost? > (like at each X docs you commit the index and close it) iwc.setMaxBufferedDocs(10); the index

Re: make data search as index progress.

2014-04-14 Thread Jose Carlos Canova
Hello, That's because NRTCachingDirectory uses a in cache memory to "mimic in memory the Directory that you used to index your files ", in theory the commit is needed because you need to flush the documents recently added otherwise this document will not be available for search until the end of th

make data search as index progress.

2014-04-14 Thread Jason Wee
https://lucene.apache.org/core/4_6_0/demo/overview-summary.html https://lucene.apache.org/core/4_6_0/demo/src-html/org/apache/lucene/demo/IndexFiles.html Hello, We are using lucene 4.6.0 and storing index on top of cassandra. As far as I understand, in order to make the index searchable, in the