Varun Thacker created SOLR-12066:
------------------------------------
Summary: Autoscaling move replica can cause core initialization
failure on the original JVM
Key: SOLR-12066
URL: https://issues.apache.org/jira/browse/SOLR-12066
Project: Solr
Issue Type: Bug
Security Level: Public (Default Security Level. Issues are Public)
Reporter: Varun Thacker
Initially when SOLR-12047 was created it looked like waiting for a state in ZK
for only 3 seconds was the culprit for cores not loading up
But it turns out to be something else. Here are the steps to reproduce this
problem
- create a 3 node cluster
- create a 1 shard X 2 replica collection to use node1 and node2 (
[http://localhost:8983/solr/admin/collections?action=create&name=test_node_lost&numShards=1&nrtReplicas=2&autoAddReplicas=true]
)
- stop node 2 : ./bin/solr stop -p 7574
- Solr will create a new replica on node3 after 30 seconds because of the
".auto_add_replicas" trigger
- At this point state.json has info about replicas being on node1 and node3
- Start node2. Bam!
{code:java}
java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException:
Unable to create core [test_node_lost_shard1_replica_n2]
...
Caused by: org.apache.solr.common.SolrException: Unable to create core
[test_node_lost_shard1_replica_n2]
at
org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1053)
...
Caused by: org.apache.solr.common.SolrException:
at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1619)
at
org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1030)
...
Caused by: org.apache.solr.common.SolrException: coreNodeName core_node4 does
not exist in shard shard1:
DocCollection(test_node_lost//collections/test_node_lost/state.json/12)={
...{code}
The practical effects of this is not big since the move replica has already put
the replica on another JVM . But to the user it's super confusing on what's
happening. He can never get rid of this error unless he manually cleans up the
data directory on node2 and restart
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
