Re: Slow softCommits under heavy load?

2023-07-23 Thread Koen De Groote
Shawn, After having a look at these files: No, I cannot share them. What I can say is that there's a couple hundred fields, dynamicFields and copyFields(each). The updatehandler uses solr.DirectUpdateHandler2(the only one I can see in the source code extending the regular updateHandler), with a

Re: Slow softCommits under heavy load?

2023-07-23 Thread ufuk yılmaz
Can it be related to file descriptor/open file handles limit? — > On 23 Jul 2023, at 14:24, Koen De Groote wrote: > > Shawn, > > After having a look at these files: No, I cannot share them. > > What I can say is that there's a couple hundred fields, dynamicFields and > copyFields(each). > >

Re: Slow softCommits under heavy load?

2023-07-23 Thread Koen De Groote
According to monitoring, there's no increase in use of file handles or file descriptors in the period of heavy load, on the entire system. On Sun, Jul 23, 2023 at 3:30 PM ufuk yılmaz wrote: > Can it be related to file descriptor/open file handles limit? > > — > > > On 23 Jul 2023, at 14:24, Koen

Re: Slow softCommits under heavy load?

2023-07-23 Thread Rahul Goswami
“The application in question was creating a document per interaction and doing a soft commit at the end of the interaction.“ You also mentioned your autoSoftCommit interval is 1 sec. If you really need NRT, I would suggest the client stop sending a softCommit upon each insert since the (extremely)

Re: Slow softCommits under heavy load?

2023-07-23 Thread Koen De Groote
Point taken. Going over the code, I am seeing *autowarm*Count="0" a few times in the config XML near various LRU and fastLRU cache definitions. Not seeing specific queries defined in any XML. Regards, Koen On Sun, Jul 23, 2023 at 7:10 PM Rahul Goswami wrote: > “The application in question was

Re: [ANNOUNCE] Apache Solr 9.3.0 released

2023-07-23 Thread David Smiley
Yes; thanks Houston! This is a notable Solr release. ~ David On Fri, Jul 21, 2023 at 4:08 PM Alessandro Benedetti wrote: > Thanks Houston and everyone involved, for the release! > > > On Fri, 21 Jul 2023, 21:56 Houston Putman, wrote: > > > The Solr PMC is pleased to announce the release of Ap

Re: Slow softCommits under heavy load?

2023-07-23 Thread Rahul Goswami
Ok if the count for cache autoWarm for the various caches is 0 then there is no cache warmup, so that shouldn’t be contributing to the slowness. For now, I would recommend increasing the autoSoftCommit interval to a higher number like 6 (1 min) and see if you observe any difference in performa