Control the number of segments without using forceMerge.

2021-07-04 Thread Alex K
Hi all, I'm trying to figure out if there is a way to control the number of segments in an index without explicitly calling forceMerge. My use-case looks like this: I need to index a static dataset of ~1 billion documents. I know the exact number of docs before indexing starts. I know the VM wher

Does Lucene have anything like a covering index as an alternative to DocValues?

2021-07-04 Thread Alex K
Hi all, I am curious if there is anything in Lucene that resembles a covering index (from the relational database world) as an alternative to DocValues for commonly-accessed values? Consider the following use-case: I'm indexing docs in a Lucene index. Each doc has some terms, which are not stored