Re: Increase in response time in case of collapse queries.

2021-03-17 Thread Florin Babes
@Gajendra we used a sort="score desc" even if we only use the head of the group. By removing this sort and leaving the default behavior (selecting the head with the highest score) our response time dropped with 42% in our synthetic load tests. În joi, 11 mar. 2021 la 20:40 Gajendra Dadheech a sc

Building suggester on multiple nodes for solr-cloud; failes due to forward

2021-03-17 Thread Martin Knoller
Hi there We have some issues with our solr-cloud setup and the suggester feature. We run solr 8.8.0 and have three nodes so far. We create collections in an import environment with a local docker solr, where we create a backup and restore the collection on the production system. Along the colle

Re: documentCache vs IO Cache?

2021-03-17 Thread Karl Stoney
OK this makes sense, thanks for the reply Shawn. On 13/03/2021, 21:34, "Shawn Heisey" wrote: On 3/13/2021 11:36 AM, Karl Stoney wrote: > Apologies if this is a silly question, I just can't find anything explaining the benefits online. > > Would anyone be able to tell me why you

Re: Increase in response time in case of collapse queries.

2021-03-17 Thread Joel Bernstein
That is an interesting finding. The default behavior is quite fast compared to the sort approach. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Mar 17, 2021 at 3:42 AM Florin Babes wrote: > @Gajendra we used a sort="score desc" even if we only use the head of the > group. By removing

Re: Increase in response time in case of collapse queries.

2021-03-17 Thread Florin Babes
Yes. It seems that if you specify sort="score desc" the collapser recomputes the score of the documents as far as I could understand from the solr's code. Thanks, Florin Babeş PHP Developer babesflo...@gmail.com În mie., 17 mar. 2021 la 15:52, Joel Bernstein a scris: > That is an interesting

Re: Difference in response times between direct to shard vs random shard with route param

2021-03-17 Thread yasoobhaider
Hi. Any help would be great -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Rule Based Authorization

2021-03-17 Thread Jason Gerlowski
Hi, Solr's Rule-Based Authz is complex to configure but this should be possible. If you share a security.json configuration you attempted, I can suggest tweaks from there to get you what you need. In case you haven't seen them, the docs here might be helpful: https://solr.apache.org/guide/8_8/ru

Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread Karl Stoney
Hi all, We're wanting to use REINDEXCOLLECTION, but our config has a relatively aggressive autoCommit interval configured by default (intentionally). Ideally I'd like to be able to disable hard commits for the duration of the reindex, but can't see a way to do that without pushing a whole new co

REINDEXCOLLECTION gradually slows

2021-03-17 Thread Karl Stoney
Hey, So we're trying to use REINDEXCOLLECTION again (solr 8.8) and similar to the last time we tried it (8.1) we see it gradually slow down; as you can see from the logs below. I terminated it early but you can see the trend in the processingRatePerSecond. I'm wondering if anyone has any idea's

Re: Increase in response time in case of collapse queries.

2021-03-17 Thread David Smiley
Oh yeah, glad you found that. It's not really a bug but something to document. The collapse filter can be conceptually thought of as something that occurs last, and thus "sees" documents in the order of your sort parameter. Thus don't specify redundant sort options inside the collapse because it

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread David Smiley
Hi Karl, Look into the "config apI". Let us know how it goes! Ideally, this feature would do this automatically. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 17, 2021 at 2:02 PM Karl Stoney wrote: > Hi all, > We're wanting to use REIN

Re: NRT Real time Get with documentCache

2021-03-17 Thread David Smiley
I agree with Erick that it shouldn't matter at all. The freshness is indifferent to the presence of that cache, since Solr is smart enough to know when it's dirty. The document cache is used by RTG and thus will play a role in performance of it. ~ David Smiley Apache Lucene/Solr Search Developer

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread Karl Stoney
Can you believe I had never come across that before! Thanks! Every day’s a school day Get Outlook for iOS From: David Smiley Sent: Wednesday, March 17, 2021 8:48:23 PM To: users@solr.apache.org Subject: Re: Disable commits during a REINDE

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread Vivaldi
I thought the REINDEXCOLLECTION puts the source collection in read-only mode, am I wrong? Doesn’t that alsı disable commits? Sent from my iPhone > On 18 Mar 2021, at 00:28, Karl Stoney > wrote: > > Can you believe I had never come across that before! Thanks! > > Every day’s a school day >

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread Karl Stoney
That's the source collection, I'm referring to the destination. @David - seeing as REINDEX creates the target collection, I had to start the process and then attempt to set the config on the destination. However setting the destination config kills the REINDEX: ``` 22:18:40.389 [DaemonStream-ka

Re: Disable commits during a REINDEXCOLLECTION

2021-03-17 Thread Karl Stoney
Bit of a hacky workaround but: * create a collection from the target config name before reindex * set property on that (which writes overlay to zookeeper) * delete the collection * run reindex * unset-property on the created collection Fro