Re: lucene Input and Output format

2017-08-01 Thread Adrien Grand
Which part of the index do you want to learn about? Here are some descriptions of the file formats: - terms dict: http://lucene.apache.org/core/6_6_0/core/org/apache/lucene/codecs/blocktree/BlockTreeTermsWriter.html - postings: http://lucene.apache.org/core/6_6_0/core/index.html?org/apache/lucene

Re: Lucene 6.6: "Too many open files"

2017-08-01 Thread Nawab Zada Asad Iqbal
Hi Erick, I am committing once after all the indexing finishes. This is a batch indexing scenario to prepare new servers or replicas, and we don't use this config for everyday operations. While batch indexing, we also modify code to skip IndexWriter.maybeApplyDeletes to optimize the commit. I hav

Re: Lucene 6.6: "Too many open files"

2017-08-01 Thread Nawab Zada Asad Iqbal
Thanks Jigar I haven't tweaked ConcurrentMergeStrategy between 4.5.0 and 6.6. Here is what I have: 30 30 On Mon, Jul 31, 2017 at 8:56 PM, Jigar Shah wrote: > I faced such problem when I used nomergepolicy, and did some code to manual > merging segments which had bug and I had same issue.

Re: Lucene 6.6: "Too many open files"

2017-08-01 Thread Uwe Schindler
Hi, You should reset those settings back to defaults (remove the inner settings in the factory). 30 merge threads will eat up all your file handles. In earlier versions of Lucene, internal limitations in IndexWriter make it unlikely, that you spawn too many threads, so 30 had no effect. In Luc

getting error " is not a SuggestField"

2017-08-01 Thread Vitaly Stroutchkov
Hi, I created a Lucene index with documents that have a SuggestField. When I run a completion query against it I'm getting an error. The code is like this (not so straightforward in the actual program): File sdir = new File(sgstPath);