Re: Number of Collections in a SolrCloud

2023-03-02 Thread David Smiley
I second Brian's experience. Specific version & numbers reached vary somewhat. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 28, 2021 at 7:23 PM Brian Lininger wrote: > Hi Matt, > We're currently running Solr 6.6.6 using Solr Cloud. De

Re: Number of Collections in a SolrCloud

2023-02-27 Thread Natarajan, Rajeswari
HI Brain and everyone, How many solr nodes per solrcloud you have to support 1000 collections , replication factor and memory allotted. In the mailing list several times the max limit of solr collections on solrcloud was discussed. Interested in the specifics and also I assume this is in prod

Re: Number of Collections in a SolrCloud

2021-06-29 Thread Brian Lininger
Hi Matt, Solr instance == Solr JVM. 80-90M docs is the total count of docs across all collections we typically have several hundred collections per Solr instance as we have a multi-tenent service and we keep all data segregated by tenent. Brian On Mon, Jun 28, 2021, 7:41 PM mtn search wrote:

Re: Number of Collections in a SolrCloud

2021-06-28 Thread mtn search
Thanks Brian! Valuable information! Followup question. When you say Solr instance, in each case do you mean SolrCloud instance? It seems so when you speak of replica count, however when you stated 80-90 million docs I wondered if you meant Solr collection. Matt On Mon, Jun 28, 2021 at 5:17 PM

Re: Number of Collections in a SolrCloud

2021-06-28 Thread Brian Lininger
Hi Matt, We're currently running Solr 6.6.6 using Solr Cloud. Depending on the application and load, we've been able to stably run upwards of 1,000 collections without a problem in a single SolrCloud. We try to keep the total replica count per Solr instance to less than 500, but have run 600-700

Re: Number of Collections in a SolrCloud

2021-06-28 Thread mtn search
I am guessing the consideration of hitting the limit of the number of collections within a SolrCloud is not a common experience. I wanted to raise this question again if perhaps anyone has any lessons learned or things to consider. We are currently planning work to migrate 300 billion plus docs o

Number of Collections in a SolrCloud

2021-06-25 Thread mtn search
Hello, I am interested to learn what others have experienced in terms of hitting a limit for the number of collections supported by a SolrCloud instance. Also, does anyone have any tips/questions for evaluating when to create a new SolrCloud and begin adding new collections to it rather than grow