Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/22850/
Java: 64bit/jdk1.8.0_172 -XX:-UseCompressedOops -XX:+UseG1GC

4 tests failed.
FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Error from server at http://127.0.0.1:32821/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:32821/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader
        at 
__randomizedtesting.SeedInfo.seed([D3FF2F40DCE2110D:5DF34F30A9FA9527]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.tearDown(TestPullReplicaErrorHandling.java:128)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:993)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Error from server at http://127.0.0.1:46103/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46103/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader
        at 
__randomizedtesting.SeedInfo.seed([D3FF2F40DCE2110D:5DF34F30A9FA9527]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.tearDown(TestPullReplicaErrorHandling.java:128)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:993)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Error from server at http://127.0.0.1:38919/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:38919/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader
        at 
__randomizedtesting.SeedInfo.seed([D3FF2F40DCE2110D:5DF34F30A9FA9527]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.tearDown(TestPullReplicaErrorHandling.java:128)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:993)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Error from server at http://127.0.0.1:45105/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:45105/solr: Could not find collection : 
pull_replica_error_handling_test_cant_connect_to_leader
        at 
__randomizedtesting.SeedInfo.seed([D3FF2F40DCE2110D:5DF34F30A9FA9527]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.tearDown(TestPullReplicaErrorHandling.java:128)
        at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:993)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14286 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/init-core-data-001
   [junit4]   2> 1953666 WARN  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 1953666 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1953668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1953668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1953668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001
   [junit4]   2> 1953668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1953668 INFO  (Thread-5087) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1953668 INFO  (Thread-5087) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1953671 ERROR (Thread-5087) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1953768 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:36551
   [junit4]   2> 1953770 INFO  (zkConnectionManagerCallback-6035-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1953773 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@55902ae4{/solr,null,AVAILABLE}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7006b952{/solr,null,AVAILABLE}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@48b21580{/solr,null,AVAILABLE}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@97cb26c{HTTP/1.1,[http/1.1]}{127.0.0.1:40645}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@24f060bd{HTTP/1.1,[http/1.1]}{127.0.0.1:33021}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.e.j.s.Server Started @1953834ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@25d71cb8{HTTP/1.1,[http/1.1]}{127.0.0.1:45295}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.e.j.s.Server Started @1953834ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=40645}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.e.j.s.Server Started @1953834ms
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=33021}
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45295}
   [junit4]   2> 1953775 ERROR (jetty-launcher-6032-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1953775 ERROR (jetty-launcher-6032-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.189Z
   [junit4]   2> 1953774 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@74064111{/solr,null,AVAILABLE}
   [junit4]   2> 1953775 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.191Z
   [junit4]   2> 1953777 ERROR (jetty-launcher-6032-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@21e100a3{HTTP/1.1,[http/1.1]}{127.0.0.1:37539}
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.e.j.s.Server Started @1953836ms
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.191Z
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37539}
   [junit4]   2> 1953777 ERROR (jetty-launcher-6032-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1953777 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.191Z
   [junit4]   2> 1953778 INFO  (zkConnectionManagerCallback-6039-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953778 INFO  (zkConnectionManagerCallback-6037-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953778 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1953778 INFO  (zkConnectionManagerCallback-6041-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953800 INFO  (zkConnectionManagerCallback-6043-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953801 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1953801 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1953801 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1953853 INFO  (jetty-launcher-6032-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1953865 INFO  (zkConnectionManagerCallback-6047-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953870 INFO  (jetty-launcher-6032-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1953881 INFO  (zkConnectionManagerCallback-6051-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953886 INFO  (zkConnectionManagerCallback-6053-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953890 INFO  (zkConnectionManagerCallback-6055-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953899 INFO  (jetty-launcher-6032-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1953924 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:33021_solr
   [junit4]   2> 1953925 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45295_solr
   [junit4]   2> 1953925 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1953925 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer Overseer 
(id=72216166038700039-127.0.0.1:33021_solr-n_0000000000) starting
   [junit4]   2> 1953925 INFO  (zkCallback-6054-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1953925 INFO  (zkConnectionManagerCallback-6063-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953926 INFO  (zkConnectionManagerCallback-6065-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953930 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1953932 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 1953932 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37539_solr
   [junit4]   2> 1953933 INFO  (zkConnectionManagerCallback-6070-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953934 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1953934 INFO  (zkCallback-6054-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1953934 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1953935 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36551/solr ready
   [junit4]   2> 1953935 INFO  
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:33021_solr
   [junit4]   2> 1953936 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 1953936 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33021_solr
   [junit4]   2> 1953936 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37539_solr"} current state version: 0
   [junit4]   2> 1953936 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33021_solr"} current state version: 0
   [junit4]   2> 1953936 INFO  (zkCallback-6054-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1953936 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1953937 INFO  (zkCallback-6069-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1953937 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1953949 INFO  (zkConnectionManagerCallback-6081-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953950 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1953950 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36551/solr ready
   [junit4]   2> 1953953 INFO  (zkConnectionManagerCallback-6082-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1953954 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1953954 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36551/solr ready
   [junit4]   2> 1953957 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1953961 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1953961 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1953984 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45295.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953987 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37539.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953987 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33021.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953991 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45295.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953992 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_45295.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953992 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37539.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953992 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37539.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953992 INFO  (jetty-launcher-6032-thread-3) 
[n:127.0.0.1:45295_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node3/.
   [junit4]   2> 1953993 INFO  (jetty-launcher-6032-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node1/.
   [junit4]   2> 1953994 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33021.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953994 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33021.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1953995 INFO  (jetty-launcher-6032-thread-2) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node2/.
   [junit4]   2> 1954048 INFO  (jetty-launcher-6032-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1954049 INFO  (zkConnectionManagerCallback-6089-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954051 INFO  (zkConnectionManagerCallback-6091-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954054 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1954056 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 1954056 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40645_solr
   [junit4]   2> 1954056 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40645_solr"} current state version: 0
   [junit4]   2> 1954056 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6054-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6080-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6069-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954056 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954068 INFO  (zkConnectionManagerCallback-6098-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954069 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 1954069 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36551/solr ready
   [junit4]   2> 1954069 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1954093 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40645.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954098 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40645.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954098 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_40645.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954099 INFO  (jetty-launcher-6032-thread-4) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node4/.
   [junit4]   2> 1954122 INFO  (zkConnectionManagerCallback-6101-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954125 INFO  (zkConnectionManagerCallback-6106-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954126 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1954126 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36551/solr ready
   [junit4]   2> 1954128 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@25d71cb8{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1954128 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1631184602
   [junit4]   2> 1954129 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 1954129 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@40b21c46: rootName = 
solr_45295, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@5ba4329c
   [junit4]   2> 1954134 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 1954134 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@7e5dccce: rootName = 
solr_45295, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@48bac951
   [junit4]   2> 1954136 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 1954136 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4c65225d: rootName = 
solr_45295, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@1c3cc9d
   [junit4]   2> 1954137 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45295_solr
   [junit4]   2> 1954137 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1954137 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:45295_solr"} current state version: 0
   [junit4]   2> 1954138 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1954138 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954138 INFO  (zkCallback-6054-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6069-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6080-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954139 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954142 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7006b952{/solr,null,UNAVAILABLE}
   [junit4]   2> 1954142 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1954143 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1954143 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1954143 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1954143 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@91487af{/solr,null,AVAILABLE}
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@33874f65{HTTP/1.1,[http/1.1]}{127.0.0.1:46829}
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server Started @1954203ms
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44301}
   [junit4]   2> 1954144 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1954144 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.558Z
   [junit4]   2> 1954145 INFO  (zkConnectionManagerCallback-6108-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954145 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1954198 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1954199 INFO  (zkConnectionManagerCallback-6112-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954201 INFO  (zkConnectionManagerCallback-6114-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954204 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1954206 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 1954206 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44301_solr
   [junit4]   2> 1954206 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:44301_solr"} current state version: 0
   [junit4]   2> 1954206 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6069-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6113-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954206 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954222 INFO  (zkConnectionManagerCallback-6121-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954223 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 1954224 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:36551/solr ready
   [junit4]   2> 1954224 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 1954235 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44301.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954240 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44301.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954240 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44301.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954241 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) 
[n:127.0.0.1:44301_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node3/.
   [junit4]   2> 1954265 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:46829/solr. Proxy: http://127.0.0.1:44301/solr
   [junit4]   2> 1954265 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@24f060bd{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1954266 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=2088179227
   [junit4]   2> 1954266 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 1954266 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@7bcd74fa: rootName = 
solr_33021, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@511d1eb
   [junit4]   2> 1954271 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 1954271 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2a4ba2f1: rootName = 
solr_33021, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@48bac951
   [junit4]   2> 1954273 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 1954273 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2ec5614c: rootName = 
solr_33021, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@1c3cc9d
   [junit4]   2> 1954274 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33021_solr
   [junit4]   2> 1954275 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1954275 DEBUG 
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33021_solr"} current state version: 0
   [junit4]   2> 1954275 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6069-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6113-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6052-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954275 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954276 INFO  (zkCallback-6120-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954276 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72216166038700039-127.0.0.1:33021_solr-n_0000000000) closing
   [junit4]   2> 1954276 INFO  
(OverseerStateUpdate-72216166038700039-127.0.0.1:33021_solr-n_0000000000) 
[n:127.0.0.1:33021_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:33021_solr
   [junit4]   2> 1954276 WARN  
(OverseerAutoScalingTriggerThread-72216166038700039-127.0.0.1:33021_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 1954278 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@48b21580{/solr,null,UNAVAILABLE}
   [junit4]   2> 1954278 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37539_solr
   [junit4]   2> 1954279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1954279 INFO  (zkCallback-6064-thread-1) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer Overseer 
(id=72216166038700042-127.0.0.1:37539_solr-n_0000000002) starting
   [junit4]   2> 1954279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1954279 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@12357ba7{/solr,null,AVAILABLE}
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3ac49642{HTTP/1.1,[http/1.1]}{127.0.0.1:38061}
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server Started @1954339ms
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=45105}
   [junit4]   2> 1954280 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1954280 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1954281 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1954281 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1954281 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1954281 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.695Z
   [junit4]   2> 1954281 INFO  
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:37539_solr
   [junit4]   2> 1954281 INFO  (zkConnectionManagerCallback-6124-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954282 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1954282 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40645_solr"} current state version: 0
   [junit4]   2> 1954282 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:45295_solr"} current state version: 0
   [junit4]   2> 1954282 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:44301_solr"} current state version: 0
   [junit4]   2> 1954282 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33021_solr"} current state version: 0
   [junit4]   2> 1954341 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1954341 INFO  (zkConnectionManagerCallback-6128-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954343 INFO  (zkConnectionManagerCallback-6130-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954345 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1954347 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1954347 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:45105_solr
   [junit4]   2> 1954347 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 5, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:45105_solr"} current state version: 0
   [junit4]   2> 1954347 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6113-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6120-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954347 INFO  (zkCallback-6129-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954359 INFO  (zkConnectionManagerCallback-6137-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954360 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1954360 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36551/solr ready
   [junit4]   2> 1954361 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 1954371 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45105.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954376 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45105.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954376 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45105.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954377 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node2/.
   [junit4]   2> 1954401 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:38061/solr. Proxy: http://127.0.0.1:45105/solr
   [junit4]   2> 1954402 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@21e100a3{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1954403 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=280035260
   [junit4]   2> 1954403 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 1954403 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6fd64e9a: rootName = 
solr_37539, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@6b561394
   [junit4]   2> 1954408 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 1954408 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@15b5e29f: rootName = 
solr_37539, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@48bac951
   [junit4]   2> 1954410 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 1954410 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@7fc5108: rootName = 
solr_37539, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@1c3cc9d
   [junit4]   2> 1954411 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37539_solr
   [junit4]   2> 1954411 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1954412 DEBUG 
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37539_solr"} current state version: 0
   [junit4]   2> 1954412 INFO  (zkCallback-6113-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954412 INFO  (zkCallback-6064-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954412 INFO  (zkCallback-6079-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  (zkCallback-6129-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  (zkCallback-6120-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72216166038700042-127.0.0.1:37539_solr-n_0000000002) closing
   [junit4]   2> 1954413 INFO  (zkCallback-6136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1954413 WARN  
(OverseerAutoScalingTriggerThread-72216166038700042-127.0.0.1:37539_solr-n_0000000002)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 1954413 INFO  
(OverseerStateUpdate-72216166038700042-127.0.0.1:37539_solr-n_0000000002) 
[n:127.0.0.1:37539_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:37539_solr
   [junit4]   2> 1954415 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@74064111{/solr,null,UNAVAILABLE}
   [junit4]   2> 1954415 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40645_solr
   [junit4]   2> 1954416 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1954416 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_172-b11
   [junit4]   2> 1954416 INFO  (zkCallback-6090-thread-1) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer Overseer 
(id=72216166038700047-127.0.0.1:40645_solr-n_0000000003) starting
   [junit4]   2> 1954416 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1954416 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1954417 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1954417 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6b3556dd{/solr,null,AVAILABLE}
   [junit4]   2> 1954417 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@5fd0615c{HTTP/1.1,[http/1.1]}{127.0.0.1:39641}
   [junit4]   2> 1954417 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.Server Started @1954476ms
   [junit4]   2> 1954417 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=34385}
   [junit4]   2> 1954417 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1954418 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1954418 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 1954418 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1954418 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1954418 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-09-13T07:32:19.832Z
   [junit4]   2> 1954419 INFO  
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:40645_solr
   [junit4]   2> 1954419 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40645_solr"} current state version: 0
   [junit4]   2> 1954420 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:45295_solr"} current state version: 0
   [junit4]   2> 1954420 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:44301_solr"} current state version: 0
   [junit4]   2> 1954420 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:33021_solr"} current state version: 0
   [junit4]   2> 1954420 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:45105_solr"} current state version: 0
   [junit4]   2> 1954420 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 6, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37539_solr"} current state version: 0
   [junit4]   2> 1954421 INFO  (zkConnectionManagerCallback-6140-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954421 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1954505 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36551/solr
   [junit4]   2> 1954506 INFO  (zkConnectionManagerCallback-6144-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954507 INFO  (zkConnectionManagerCallback-6146-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954509 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1954511 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1954511 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34385_solr
   [junit4]   2> 1954511 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 7, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:34385_solr"} current state version: 0
   [junit4]   2> 1954511 INFO  (zkCallback-6129-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6113-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6105-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6120-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6097-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6136-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954511 INFO  (zkCallback-6090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954512 INFO  (zkCallback-6145-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1954523 INFO  (zkConnectionManagerCallback-6153-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1954524 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1954524 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36551/solr ready
   [junit4]   2> 1954524 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 1954535 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34385.solr.node' (registry 
'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954541 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34385.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954541 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34385.solr.jetty' (registry 
'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@320c9086
   [junit4]   2> 1954542 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-001/tempDir-001/node1/.
   [junit4]   2> 1954582 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:39641/solr. Proxy: http://127.0.0.1:34385/solr
   [junit4]   2> 1954583 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@97cb26c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1954583 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=446839305
   [junit4]   2> 1954583 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 1954583 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@723032d5: rootName = 
solr_40645, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@56c0f2e3
   [junit4]   2> 1954588 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 1954589 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@795d19e9: rootName = 
solr_40645, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@48bac951
   [junit4]   2> 1954591 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 1954591 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@558d8e66: rootName = 
solr_40645, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@1c3cc9d
   [junit4]   2> 1954592 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40645_solr
   [junit4]   2> 1954593 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 1954593 DEBUG 
(OverseerStateUpdate-72216166038700047-127.0.0.1:40645_solr-n_0000000003) 
[n:127.0.0.1:40645_solr    ] o.a.s.c.Overseer processMessage: queueSize: 8, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40645_solr"} curren

[...truncated too long message...]

        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   2>        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2>        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:674)
   [junit4]   2>        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2>        at 
org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   2>        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   2>        at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   2>        at 
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2>        at 
org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   2>        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer/queue/qn-
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:786)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:398)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:398)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkDistributedQueue.offer(ZkDistributedQueue.java:321)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.unregister(ZkController.java:1605)
   [junit4]   2>        at 
org.apache.solr.cloud.ZkController.unregister(ZkController.java:1573)
   [junit4]   2>        at 
org.apache.solr.core.CoreContainer.unload(CoreContainer.java:1524)
   [junit4]   2>        ... 40 more
   [junit4]   2> 
   [junit4]   2> 1269612 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1269612 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[D3FF2F40DCE2110D]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:41891 41891
   [junit4]   2> 1270395 INFO  (Thread-105) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41891 41891
   [junit4]   2> 1270396 WARN  (Thread-105) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        18      /solr/aliases.json
   [junit4]   2>        17      /solr/clusterprops.json
   [junit4]   2>        9       
/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/terms/shard1
   [junit4]   2>        9       /solr/security.json
   [junit4]   2>        9       /solr/configs/conf
   [junit4]   2>        8       
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard1
   [junit4]   2>        8       
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard2
   [junit4]   2>        7       
/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        18      /solr/clusterstate.json
   [junit4]   2>        10      /solr/clusterprops.json
   [junit4]   2>        8       
/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
   [junit4]   2>        6       /solr/autoscaling.json
   [junit4]   2>        4       
/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
   [junit4]   2>        2       
/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        18      /solr/collections
   [junit4]   2>        17      /solr/live_nodes
   [junit4]   2>        6       /solr/overseer/queue
   [junit4]   2>        6       /solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2>        6       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        6       /solr/overseer/collection-queue-work
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_D3FF2F40DCE2110D-002
   [junit4]   2> Sep 13, 2018 8:38:23 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{fieldName_s=PostingsFormat(name=Direct), id=Lucene50(blocksize=128)}, 
docValues:{}, maxPointsInLeafNode=1934, maxMBSortInHeap=5.28365128294604, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3f79a027),
 locale=en-IN, timezone=Europe/Athens
   [junit4]   2> NOTE: Linux 4.15.0-32-generic amd64/Oracle Corporation 
1.8.0_172 (64-bit)/cpus=8,threads=1,free=351215608,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestPullReplicaErrorHandling, TestPullReplicaErrorHandling]
   [junit4] Completed [5/5 (5!)] on J0 in 628.55s, 3 tests, 1 error <<< 
FAILURES!
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: D3FF2F40DCE2110D]:
   [junit4]   - 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4]   - 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4]   - 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4]   - 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4]   - 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.43 ..  1271.42 =  1270.99s
   [junit4] JVM J1:     0.42 ..   730.62 =   730.20s
   [junit4] JVM J2:     0.43 ..  1260.38 =  1259.95s
   [junit4] Execution time total: 21 minutes 11 seconds
   [junit4] Tests summary: 5 suites, 15 tests, 5 errors

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: 
The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: 
There were test failures: 5 suites, 15 tests, 5 errors [seed: D3FF2F40DCE2110D]

Total time: 21 minutes 12 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.TestPullReplicaErrorHandling
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=4a5b914eaa8683009191748bf6c0b1be14d59661, 
workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #22849
Recording test results
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to