Re: ArithmeticException: due to integer overflow during lucene merging

2024-05-14 Thread Jerven Tjalling Bolleman
Hi Michael, The index that had an issue when merging into one segment definitely had more than 1 billion times the word "positional" in it. I hope to be able to give a closer number once re-indexing finished with a "work-around". Of course the "work-around" is to just fix this correctly by not

Re: ArithmeticException: due to integer overflow during lucene merging

2024-05-14 Thread Michael McCandless
I think we should at least open an issue to try to improve the exception message? We might catch the exception higher up (where we know the field name) and rethrow with the field name, maybe. We can discuss options on the issue ... If you are not using custom term frequencies it's not clear to m