On 7/23/23 05:24, Koen De Groote wrote:
After having a look at these files: No, I cannot share them.
What I can say is that there's a couple hundred fields, dynamicFields and
copyFields(each).
The updatehandler uses solr.DirectUpdateHandler2(the only one I can see in
the source code extending the regular updateHandler), with a max autoCommit
time of 60000 and a max autoSoftCommit time of 1000
You can cause yourself no end of problems with that super short
autoSoftCommit. It can lead to lots of commits happening at the same time.
What I would start with is reducing the autoCommit interval, to 30000 or
15000, and greatly increasing the autoSoftCommit interval, to at least
30000, maybe even as high as 120000.
Stop sending explicit commits. You especially don't want to do a commit
after every document ... that has the potential to be even worse than
one autoSoftCommit per second.
If possible, you should also be indexing a lot more than one document
per indexing request.
Thanks,
Shawn
