Solr 9.1 performance

2022-12-02 Thread Joe Jones (DHCW - Software Development)
Hello all, We currently have a Solr cloud set up under version 5.4.1 running on Windows. It contains 45 million records in a collection split across 12 shards with a replication factor of 2. The 12 shards are hosted across 6 servers running 4 nodes each. 3 servers are in one data center and 3

Re: Solr 9.1 performance

2022-12-02 Thread Jan Høydahl
Could it be related to https://solr.apache.org/news.html#java-17-bug-affecting-solr ? Doubt it as you don't use much caching, but hotspot optimization of caches are disabled by default in 9.1. You could try to edit bin/solr script to disable the patch and see if anything is faster - risking a s

Re: 8.11.2 Performance degradation

2022-12-02 Thread Richard Goodman
Hi Charlie, Gah, thanks for informing me of that, here is a link to the images is here Cheers, On Tue, 29 Nov 2022 at 13:23, Charlie Hull wrote: > Hey Richard, > > Attachments are stripped by this list so you might want to upload them > somewhere and link to them

Re: Wired behavior of maxClauseCount restriction since upgrading to solr 9.1

2022-12-02 Thread michael dürr
Hi Jan, thanks! That helped :-) On Fri, Dec 2, 2022 at 8:47 AM Jan Høydahl wrote: > A plain q=id:(a b c) is parsed into a boolean query with three SHOULD > clauses, i.e. OR. Try to add &debugQuery=true to a request and see how it > gets parsed. Then if the limit is 1024 you'll get errors above.

RE: Very High CPU when indexing

2022-12-02 Thread Matias Laino
Hello Jan, thanks for your reply! I'm not very experienced with Cache settings on solr, this is the first time I'm setting it up myself. These are the settings I was able to find on our solrconfig.xml In the meantime, I'll investigate about cachin, thanks again! MATIAS LAINO | DIRECTOR

RE: Solr 9.1 performance

2022-12-02 Thread Joe Jones (DHCW - Software Development)
No, out of the box 9.1 doesn't include the patch. Tried adding it in and no difference. I've done some testing running the queries with "distrib=false" and can see the query itself runs fine it's just the call to the instance and the response is slow. Something to do with Jetty? -Origina

Re: 8.11.2 Performance degradation

2022-12-02 Thread Alessandro Benedetti
Hi Richard, when you mention "In particular which sparked interest, and so we spun up a parallel cluster with -Dsolr.http1=true, and there was no difference in performance. ", do you mean that you still see the degradation in performance right? I will probably state the obvious but normally you wo

Re: Solr 9.1 performance

2022-12-02 Thread Jan Høydahl
What I'm saying is that 9.1 includes a workaround for the cache issues, see https://github.com/apache/solr/blob/releases/solr/9.1.0/solr/bin/solr#L2246-L2250 You may want to try to disable this workaround to see if it helps with the performance of your system. Alternatively try with JDK11, which

Re: solr and dovecot: high load

2022-12-02 Thread Shawn Heisey
On 12/1/22 02:47, alessia.gagli...@qboxmail.it.INVALID wrote: We have another solr (that handles less users) that had a high I/O activity, which was reduced after increasing the physical memory from 24GB to 48GB. Could this be a scalable solution? More memory not consumed by programs will ofte

Re: SOLR adding ,​ to strings erroneously

2022-12-02 Thread Shawn Heisey
On 12/1/22 05:41, Eric Pugh wrote: Shawn, Have we received a couple of mentions of this? Or am I misremembering? Do we need to open a JIRA and change how logging.js works? This is the first mention of this that I can recall seeing, apparently I missed Dmitri's issue. I'm curious as to wh