[
https://issues.apache.org/jira/browse/SOLR-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13897763#comment-13897763
]
Shalin Shekhar Mangar commented on SOLR-5146:
---------------------------------------------
Sure Erick. I've been studying the code for transient cores to understand the
potential issues and bottlenecks with using this feature with SolrCloud.
I think we can break it down to four major features:
# Make loadOnStartup=true work with SolrCloud shards - slices are marked with
loadOnStartup=false. All nodes are woken up on a request.
# Make transient replicas work with SolrCloud replication - Leader is always
active, replicas are down. Leader can send 'requestrecovery' to replicas based
on maxDocs/maxTime parameters to make them sync. Maybe we can make peersync and
buffer doc counts configurable.
# Make transient leaders work with SolrCloud - Down leaders are okay. Replicas
may still be up but we won't force leader election. Leaders are woken up only
on a write request.
# Optimize leader election for transient shards - We probably don't want to
force leader election each time a shard wakes up. Instead clusterstate can
remain the truth and leaders can go down. If a shard is woken up again, it can
use the same leader until it goes down. This is far away. We shall focus on
optimization later.
I think an easy win here would be to translate loadOnStartup=false to complete
shards (leader+replicas). I'm going to start building a prototype and see how
easy it turns out to be :)
> Figure out what it would take for lazily-loaded cores to play nice with
> SolrCloud
> ---------------------------------------------------------------------------------
>
> Key: SOLR-5146
> URL: https://issues.apache.org/jira/browse/SOLR-5146
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Affects Versions: 4.5, 5.0
> Reporter: Erick Erickson
> Assignee: Shalin Shekhar Mangar
> Fix For: 5.0
>
>
> The whole lazy-load core thing was implemented with non-SolrCloud use-cases
> in mind. There are several user-list threads that ask about using lazy cores
> with SolrCloud, especially in multi-tenant use-cases.
> This is a marker JIRA to investigate what it would take to make lazy-load
> cores play nice with SolrCloud. It's especially interesting how this all
> works with shards, replicas, leader election, recovery, etc.
> NOTE: This is pretty much totally unexplored territory. It may be that a few
> trivial modifications are all that's needed. OTOH, It may be that we'd have
> to rip apart SolrCloud to handle this case. Until someone dives into the
> code, we don't know.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
