Re: Which method is more performant? SubQueries or Collapsing the results?

Hi, Daxesh. Subqueries handle only a single result page, at contrast, collapse should count the total number of groups (I suppose). I can say that subquery implementation is far from being performant. On Wed, Sep 21, 2022 at 7:41 AM Daxesh Parmar wrote: > Hii, > > Can anyone pls provide document

Identifying SOLR [query] performance issue (or "how to scale up")

Hi all, I'm trying to identify a SOLR query performance issue (or rather how to size [AWS EC2] hardware to support many users). Right now I'm testing on a single SOLR node (with distrib=false to keep the query to the one node). I'm using Apache JMeter to test (with many different queries in a CS

Re: Loading solr.xml from zookeeper

Hi, Since 9.0 Solr can start with an empty SOLR_HOME as it will use defaults in their place : "Solr no longer requires a solr.xml in $SOLR_HOME. If one is not found, Solr will instead use the default one from $S

Re: Identifying SOLR [query] performance issue (or "how to scale up")

what is the iops allocated to your aws instance? On Wed, 21 Sep 2022, 17:36 Derek C, wrote: > Hi all, > > I'm trying to identify a SOLR query performance issue (or rather how to > size [AWS EC2] hardware to support many users). > > Right now I'm testing on a single SOLR node (with distrib=false

Re: Identifying SOLR [query] performance issue (or "how to scale up")

Hi Deepak, IOPs is something I have looked at and adjusted over the last few weeks. I'm now using a "GP3" disk type set to 3,000 IOPS. (The other week I tested IOPS/data throughput with fio and it's delivering as promised). Funny though - I think because the instance has 64Gbytes of RAM and I've

Re: Identifying SOLR [query] performance issue (or "how to scale up")

I guess i will have to see the 1500 queries running in Jmeter. Are they distinct from each other? Are they parameterized? On Wed, 21 Sep 2022, 19:10 Derek C, wrote: > Hi Deepak, > > IOPs is something I have looked at and adjusted over the last few weeks. > I'm now using a "GP3" disk type set to

Re: Identifying SOLR [query] performance issue (or "how to scale up")

| I think because the instance has 64Gbytes of RAM and I've divided this up into 32Gbytes to the JVM reduce it to 30 or 31 for the JVM, 32 ->64 is not a good idea. it triggers a pointer flip to 64bit https://blog.codecentric.de/en/2014/02/35gb-heap-less-32gb-java-jvm-memory-oddities/ On Wed, S

Re: Identifying SOLR [query] performance issue (or "how to scale up")

Thanks Deepak, I'm going to do more testing and check my queries more carefully (I dumped a pile of different queries - all different searches and I made JMeter run the 5,000 from beginning to end and then stop so no repeats but I think I should retest with other more simple queries) Derek

Re: Identifying SOLR [query] performance issue (or "how to scale up")

HI David, thanks v much - I'll certainly try this - it'll be quick and easy to test. Derek On Wed, Sep 21, 2022 at 3:21 PM David Hastings wrote: > | I think because the instance has 64Gbytes of RAM and I've > divided this up into 32Gbytes to the JVM > > reduce it to 30 or 31 for the JVM, 32 ->

Re: Identifying SOLR [query] performance issue (or "how to scale up")

Can you please also post the iotop? You had mentioned you were seeing some writes io. On Wed, 21 Sep 2022, 20:01 Derek C, wrote: > Thanks Deepak, > > I'm going to do more testing and check my queries more carefully (I dumped > a pile of different queries - all different > searches and I made JMe

Re: Identifying SOLR [query] performance issue (or "how to scale up")

In the real world, many queries are repeated, so it is best to replay logged queries keeping all the dupes. wunder Walter Underwood https://observer.wunderwood.org/ > On Sep 21, 2022, at 4:31 PM, Derek C wrote: > > Thanks Deepak, > > I'm going to do more testing and check my queries more c

Re: Backup and restore collections and configsets in Solr 8.11.2

Yes, solr has Backup APIs that will include the configSet in the backup. Please refer to the reference guide for more information: https://solr.apache.org/guide/solr/latest/deployment-guide/collection-management.html#backup - Houston On Mon, Sep 19, 2022 at 9:34 AM Kaushal Shriyan wrote: > On

Re: Loading solr.xml from zookeeper

I have also never seen people use a ZK solr.xml, and I see the solr.xml as a node-config file. I'd be very happy to only support file-system solr.xml loading. On Wed, Sep 21, 2022 at 9:11 AM Jan Høydahl wrote: > Hi, > > Since 9.0 Solr can start with an empty SOLR_HOME as it will use defaults > i

Re: Loading solr.xml from zookeeper

Hi we are using solr.xml from zk as we are using it for storing multiple repositories in a single file. On Wed, 21 Sep 2022 at 12:25 PM, Houston Putman wrote: > I have also never seen people use a ZK solr.xml, and I see the solr.xml as > a node-config file. I'd be very happy to only support f

Re: Loading solr.xml from zookeeper

ANNAMANENI: can you clarify what you mean by "multiple repositories"; maybe "repositories" is a word with specific meaning for your system. If this functionality were removed, would something be harder? I'm going to guess you aren't using Docker / containers yet. ~ David Smiley Apache Lucene/Sol

Re: Loading solr.xml from zookeeper

Is there a trusted guide for running solr in docker out there? I’ve seen a few but just wondering if you got one you like the most > On Sep 21, 2022, at 1:32 PM, David Smiley wrote: > > ANNAMANENI: can you clarify what you mean by "multiple repositories"; maybe > "repositories" is a word wit

Re: Loading solr.xml from zookeeper

> > Is there a trusted guide for running solr in docker out there? I’ve seen > a few but just wondering if you got one you like the most > https://solr.apache.org/guide/solr/latest/deployment-guide/solr-in-docker.html This is the official guide. It was ported from the docs of the original docker

Re: Loading solr.xml from zookeeper

On 9/21/22 07:10, Jan Høydahl wrote: Since 9.0 Solr can start with an empty SOLR_HOME as it will use defaults in their place : "Solr no longer requires a solr.xml in $SOLR_HOME. If one is not found, Solr will ins

Re: Loading solr.xml from zookeeper

Thanks Shawn It would surely be nice with a spring clean of configs for some future major version. Welcome to start a dev-list thread on that :) The important for this thread is to decide what solr.xml is and isn’t. I think another key point is whether a config in solr.xml requires a node resta

User access to deployed Solr instance

I have a standalone instance of Solr 8.11 secured with SSL and Basic Authentication. I also have a website with registered users' credentials (username, password, ...) stored in a MySQL database. Questions: 1. What is the best way to allow registered users access to a Solr core (and unregiste

Re: Loading solr.xml from zookeeper

Sent this once already but it never made it to the list.  Checked apache mail archives to make sure it wasn't just me.  It's not there. On 9/21/22 07:10, Jan Høydahl wrote: Since 9.0 Solr can start with an empty SOLR_HOME as it will use defaults in their place