Re: [EXTERNAL] - Re: Is docvalue sorted by value?

2018-03-06 Thread Tony Ma
h you decide at index time. You can still sort by any field at the same expense as now, but since your docs are ordered by one field the early termination part won't be applicable to other fields. Best, Erick On Mon, Mar 5, 2018 at 6:28 PM, Tony Ma w

Re: [EXTERNAL] - Re: Is docvalue sorted by value?

2018-03-05 Thread Tony Ma
r document in order, you might consider using PointValues. PointValues are internally indexed with KD-trees. But, beware that PointValues have a limited dimensionality, in terms that you can for example store values in 8 dimensions, each of max 16 bytes. > >> On 5 Mar 2018, a

Is docvalue sorted by value?

2018-03-05 Thread Tony Ma
Per my understanding, doc values (binary doc values / numeric doc values) are stored with sequence of document id. Sorted numeric doc values just means if a document has multiple values, the values will be sorted for same document, but for different documents, the value is still ordered by docum

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-04 Thread Tony Ma
tions, etc will compress differently). On Fri, Feb 2, 2018 at 9:19 AM, Tony Ma wrote: > Thanks Rebert. > > We are not going to use merge to repair corrupted index, the issue we are seeing is that as a segment is already got corrupted, but merges usually run automatically i

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Tony Ma
On Fri, Feb 2, 2018 at 3:08 AM, Tony Ma wrote: > Hi experts, > > A question to corrupted index. If an index segment is already corrupted, can it be merged with another segment. Or it depends on where it got corrupted, for example corrupted in .pay file? >

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-02-02 Thread Tony Ma
e a sequence of payload. We also put freshness boost value into payload in another field, which have no issues. It is the first customer report the corruption after we used Lucene 4.5.1 and released our product for many years. Please let me know if you have any idea to this issue. Thanks, Tony Ma(马江)

Re: [EXTERNAL] - Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-01-18 Thread Tony Ma
ave no issues. It is the first customer report the corruption after we used Lucene 4.5.1 and released our product for many years. Please let me know if you have any idea to this issue. Thanks, Tony Ma(马江)

Lucene 4.5.1 payload corruption - ArrayIndexOutOfBoundsException

2018-01-15 Thread Tony Ma
idea to this issue. Thanks, Tony Ma(马江) Checking consistency of: [CHECK_INDEXES_CONSISTENCY] Library child /dpwprd/dsearch/Data/Collection2 is not in consistent state, errors report: Library child name=/dpwprd/dsearch/Data/Collection2