On 1/10/2023 1:02 PM, Justin Sweeney wrote:
I'm working on upstreaming a PR to allow
compression of state.json in ZK which would help a bit here:
https://github.com/apache/solr/pull/1267.
Compression is an interesting idea. I'm not sure it would help with the
problems I found here:
https://
Thanks Justin, it's really helpful. Are the challenges for state.json
update caused by number of replicas or number of shards? Is the Per
Replica State feature is available in Solr 8.8 and later?
Regards,
Wei
On Tue, Jan 10, 2023 at 12:02 PM Justin Sweeney
wrote:
> We are running clusters w
We are running clusters with 100s of nodes in a single Solr Cloud with many
collections, some of which are up to 2,048 shards. Generally the challenges
that we have seen have been specifically related to handling updates to
state.json particularly on restarts of nodes in the cluster since a node
re
Thanks Walter. We have 1-to-1 mapping, each physical server hosts a single
solr core so that CPU resource per node is sufficient. Because of the
constant index size growth and each shard can only hold X million
documents, and we don't want shards to reach their maximum capacity,
therefore the numb
> On Jan 9, 2023, at 1:29 PM, Wei wrote:
>
> Is there a practical limit on the number of shards and nodes in a solr
> cloud? We need to scale up the solr cloud and wonder if there is concern
> when increasing to a couple of hundred shards and several thousand nodes in
> a single cloud. Any sugge
> On Jan 9, 2023, at 1:29 PM, Wei wrote:
>
> Is there a practical limit on the number of shards and nodes in a solr
> cloud? We need to scale up the solr cloud and wonder if there is concern
> when increasing to a couple of hundred shards and several thousand nodes in
> a single cloud. Any sugge
Hi team,
Is there a practical limit on the number of shards and nodes in a solr
cloud? We need to scale up the solr cloud and wonder if there is concern
when increasing to a couple of hundred shards and several thousand nodes in
a single cloud. Any suggestions?
Thanks,
Wei
