Ranking based on number of OR clauses matched

2022-08-26 Thread Noah Torp-Smith
We have a search engine with books that have topics and other features. We do faceting on these features, and allow users to check off topics they are interested in, in the UI. If a user checks off more than one topic, we retrieve books that have any of the topics checked off, so the search beco

Re: Ranking based on number of OR clauses matched

2022-08-26 Thread Alessandro Benedetti
Hi Noah, That's pretty much the default if you go with a pure boolean query! Do you see a different behaviour? What is your query? Cheers On Fri, 26 Aug 2022, 11:22 Noah Torp-Smith, wrote: > We have a search engine with books that have topics and other features. We > do faceting on these featu

Sv: Ranking based on number of OR clauses matched

2022-08-26 Thread Noah Torp-Smith
Hi Alex, thanks for responding so quickly. I guess (but I'll need to verify) the issue is that we boost on some other things by default. Thigs like how often has stuff been loaned, how many copies are there in the libraries. That seems to (but again, I'll need to make some experiments to verify

Sv: Ranking based on number of OR clauses matched

2022-08-26 Thread Noah Torp-Smith
OK, I've narrowed it down a bit. I can recreate the behaviour with this (I am sending to the /query endpoint, not /select). We are sending the selected checkboxes as filters (fq in /select lingo, I guess). === { "query": "dyr", "filter": [ "work.subject_docval:(\"uddøde dyr\" \"f

Re: Ranking based on number of OR clauses matched

2022-08-26 Thread Dave
Why is your qf set to only those two fields and not the subject? Also in the qf you can boost them. The filter query has no effect on the score, it just eliminates documents that don’t meet your query > On Aug 26, 2022, at 7:55 AM, Noah Torp-Smith wrote: > > OK, I've narrowed it down a bit.

Re: Solr 6 vs Solr 8 considerable performance gap

2022-08-26 Thread Shawn Heisey
On 8/26/22 02:55, Sidharth Negi wrote: We set up Solr 6 and Solr 8 on two identical AWS instances (16 cores, 128 GB of which Solr was given Xmx=50GB) and indexed the same data on them and tested under the same load of traffic. The schema and solrconfig.xml are exactly identical - the schema fil

Re: Solr 6 vs Solr 8 considerable performance gap

2022-08-26 Thread Deepak Goel
Are the response times the same for the 2 machines? Or is Solr8 faster than Solr6? Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deic

How to change solr.maxBooleanClauses limit in Solr 8.11 in Solr cloud mode

2022-08-26 Thread Su, Weiling
We have a need to set the maxBooleanClauses=10240 with Solr 8.11 in solr cloud mode. We overwrite the system variable default through solrcloud.yaml file and rolling restart the severs one by one. The new System variable is shown up in Solr admin’s Java properties page. But it has no effect on

Re: Solr 6 vs Solr 8 considerable performance gap

2022-08-26 Thread Sidharth Negi
Interesting to note that when I ran the experiment with Solr 9, the CPU usage was about the same as Solr 6. On Fri, Aug 26, 2022 at 7:02 PM Shawn Heisey wrote: > On 8/26/22 02:55, Sidharth Negi wrote: > > We set up Solr 6 and Solr 8 on two identical AWS instances (16 cores, > > 128 GB of which S

Re: Solr 6 vs Solr 8 considerable performance gap

2022-08-26 Thread Sidharth Negi
Errata: I meant 80k requests per minute and NOT 80k per second. On Sat, Aug 27, 2022 at 1:48 AM Sidharth Negi wrote: > Interesting to note that when I ran the experiment with Solr 9, the CPU > usage was about the same as Solr 6. > > On Fri, Aug 26, 2022 at 7:02 PM Shawn Heisey > wrote: > >> On

Re: Solr 6 vs Solr 8 considerable performance gap

2022-08-26 Thread Shawn Heisey
On 8/26/22 14:18, Sidharth Negi wrote: The disk space taken by the index of both Solr versions was about ~35 GB and the number of docs ~30 million in both. Unless that system is handling insanely complex queries that chew up lots of memory, I would not expect it to need more than about 8GB of

Re: How to change solr.maxBooleanClauses limit in Solr 8.11 in Solr cloud mode

2022-08-26 Thread Shawn Heisey
On 8/26/22 09:44, Su, Weiling wrote: I checked the documentation, it seems that Solr Cloud is using zookeeper to store solr.xml. (https://solr.apache.org/guide/8_11/format-of-solr-xml.html#defining-solr-xml). Any ideas on how to make the above configuration changes to reach Solr query? SolrC