Re: Searching number of tokens in text field

2020-01-02 Thread Matt Davis
Thanks Mike that is very helpful. Am I reading the code correctly that the norm lossy encoding is done in the similarity? How do you set the number of bytes used for the norms? Thanks, Matt On Thu, Jan 2, 2020 at 10:31 AM Michael McCandless < luc...@mikemccandless.com> wrote: > Norms encode th

Re: Searching number of tokens in text field

2020-01-02 Thread Michael McCandless
Norms encode the number of tokens in the field, but in a lossy manner (1 byte by default), so you could probably create a custom query that filtered based on that, if you could tolerate the loss in precision? Or maybe change your norms storage to more precision? You could use NormsFieldExistsQuer