Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/619/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToPullReplica

Error Message:
Timeout occured while waiting response from server at: 
http://127.0.0.1:64516/solr/pull_replica_error_handling_test_cant_connect_to_pull_replica_shard1_replica_n1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: 
http://127.0.0.1:64516/solr/pull_replica_error_handling_test_cant_connect_to_pull_replica_shard1_replica_n1
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.assertNumDocs(TestPullReplicaErrorHandling.java:241)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.assertNumDocs(TestPullReplicaErrorHandling.java:251)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToPullReplica(TestPullReplicaErrorHandling.java:151)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at 
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at 
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at 
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at 
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at 
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at 
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
        at 
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
        ... 47 more


FAILED:  
org.apache.solr.cloud.TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper

Error Message:
Expecting node to be disconnected null Live Nodes: [127.0.0.1:64502_solr, 
127.0.0.1:64510_solr, 127.0.0.1:64516_solr] Last available state: 
DocCollection(pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper//collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json/5)={
   "pullReplicas":"1",   "replicationFactor":"1",   "shards":{"shard1":{       
"range":"80000000-7fffffff",       "state":"active",       "replicas":{         
"core_node3":{           
"core":"pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_n1",
           "base_url":"http://127.0.0.1:64502/solr";,           
"node_name":"127.0.0.1:64502_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node4":{           
"core":"pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_p2",
           "base_url":"http://127.0.0.1:64496/solr";,           
"node_name":"127.0.0.1:64496_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}}}},   
"router":{"name":"compositeId"},   "maxShardsPerNode":"1",   
"autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expecting node to be disconnected
null
Live Nodes: [127.0.0.1:64502_solr, 127.0.0.1:64510_solr, 127.0.0.1:64516_solr]
Last available state: 
DocCollection(pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper//collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json/5)={
  "pullReplicas":"1",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          
"core":"pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_n1",
          "base_url":"http://127.0.0.1:64502/solr";,
          "node_name":"127.0.0.1:64502_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node4":{
          
"core":"pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper_shard1_replica_p2",
          "base_url":"http://127.0.0.1:64496/solr";,
          "node_name":"127.0.0.1:64496_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"}
        at 
__randomizedtesting.SeedInfo.seed([DC70601A2BC5FAC6:C33940990E2FF5A6]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:278)
        at 
org.apache.solr.cloud.TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper(TestPullReplicaErrorHandling.java:230)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14654 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/init-core-data-001
   [junit4]   2> 2750668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001
   [junit4]   2> 2750668 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2750735 INFO  (Thread-4399) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2750735 INFO  (Thread-4399) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2750738 ERROR (Thread-4399) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2750845 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:64472
   [junit4]   2> 2750888 INFO  (zkConnectionManagerCallback-8780-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750895 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2750895 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2750895 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2750895 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2750896 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2750896 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2750896 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2750897 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@174c60b6{/solr,null,AVAILABLE}
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@46cfcab5{HTTP/1.1,[http/1.1]}{127.0.0.1:64474}
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.e.j.s.Server Started @2750978ms
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64474}
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2750898 ERROR (jetty-launcher-8777-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@560a7c17{/solr,null,AVAILABLE}
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2750898 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:11.947Z
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3108eb6{HTTP/1.1,[http/1.1]}{127.0.0.1:64475}
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.e.j.s.Server Started @2750978ms
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64475}
   [junit4]   2> 2750899 ERROR (jetty-launcher-8777-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2750899 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:11.948Z
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@753cf76b{/solr,null,AVAILABLE}
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@1f7962a0{HTTP/1.1,[http/1.1]}{127.0.0.1:64477}
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.e.j.s.Server Started @2750981ms
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64477}
   [junit4]   2> 2750901 ERROR (jetty-launcher-8777-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:11.950Z
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2750901 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@432829be{/solr,null,AVAILABLE}
   [junit4]   2> 2750906 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@7b2b14eb{HTTP/1.1,[http/1.1]}{127.0.0.1:64479}
   [junit4]   2> 2750906 INFO  (zkConnectionManagerCallback-8784-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.e.j.s.Server Started @2750986ms
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64479}
   [junit4]   2> 2750907 ERROR (jetty-launcher-8777-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2750907 INFO  (zkConnectionManagerCallback-8782-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:11.956Z
   [junit4]   2> 2750907 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2750907 INFO  (zkConnectionManagerCallback-8786-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750908 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2750908 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2750917 INFO  (zkConnectionManagerCallback-8788-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750918 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2750923 INFO  (jetty-launcher-8777-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2750923 INFO  (jetty-launcher-8777-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2750925 INFO  (zkConnectionManagerCallback-8794-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750925 INFO  (zkConnectionManagerCallback-8796-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750927 INFO  (jetty-launcher-8777-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2750928 INFO  (jetty-launcher-8777-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2750930 INFO  (zkConnectionManagerCallback-8802-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750930 INFO  (zkConnectionManagerCallback-8806-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750930 INFO  (zkConnectionManagerCallback-8804-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750930 INFO  (zkConnectionManagerCallback-8808-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750934 INFO  (zkConnectionManagerCallback-8810-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2750936 INFO  (zkConnectionManagerCallback-8812-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751167 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2751168 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2751168 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2751168 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2751169 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:64479_solr
   [junit4]   2> 2751170 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64474_solr
   [junit4]   2> 2751170 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64475_solr
   [junit4]   2> 2751170 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64477_solr
   [junit4]   2> 2751173 INFO  (zkCallback-8807-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2751173 INFO  (zkCallback-8803-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2751192 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.Overseer Overseer 
(id=72070031171125259-127.0.0.1:64479_solr-n_0000000000) starting
   [junit4]   2> 2751194 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2751194 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2751194 INFO  (zkCallback-8807-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2751214 INFO  (zkConnectionManagerCallback-8825-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751215 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 2751216 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2751220 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2751221 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64479_solr
   [junit4]   2> 2751223 INFO  (zkCallback-8803-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2751223 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2751223 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2751223 INFO  (zkCallback-8807-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2751223 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2751679 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64475.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751688 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64475.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751689 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64475.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751695 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node4/.
   [junit4]   2> 2751700 INFO  (zkConnectionManagerCallback-8830-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751701 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64474.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751708 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64474.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751709 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64474.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751710 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node2/.
   [junit4]   2> 2751713 INFO  (zkConnectionManagerCallback-8835-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751714 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2751715 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2751717 INFO  (jetty-launcher-8777-thread-4) 
[n:127.0.0.1:64475_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2751717 INFO  (jetty-launcher-8777-thread-2) 
[n:127.0.0.1:64474_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2751789 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64479.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751805 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64479.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751806 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64479.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751807 INFO  (jetty-launcher-8777-thread-1) 
[n:127.0.0.1:64479_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node1/.
   [junit4]   2> 2751863 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64477.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751874 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64477.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751874 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64477.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2751876 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node3/.
   [junit4]   2> 2751899 INFO  (zkConnectionManagerCallback-8840-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751901 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2751904 INFO  (jetty-launcher-8777-thread-3) 
[n:127.0.0.1:64477_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2751946 INFO  (zkConnectionManagerCallback-8842-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751951 INFO  (zkConnectionManagerCallback-8847-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2751953 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2751955 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:64472/solr ready
   [junit4]   2> 2751983 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@3108eb6{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2751990 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1492260037
   [junit4]   2> 2751990 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 2751990 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@48d1d8f5: rootName = 
solr_64475, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@77450012
   [junit4]   2> 2751997 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 2751997 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2a93cdf0: rootName = 
solr_64475, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@66062815
   [junit4]   2> 2752002 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 2752002 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@7ce89d20: rootName = 
solr_64475, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@565ab647
   [junit4]   2> 2752004 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64475_solr
   [junit4]   2> 2752006 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 2752006 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 2752007 INFO  (zkCallback-8803-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752007 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752007 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752007 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752007 INFO  (zkCallback-8807-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752007 INFO  (zkCallback-8834-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752008 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752009 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752009 INFO  (zkCallback-8829-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2752011 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@560a7c17{/solr,null,UNAVAILABLE}
   [junit4]   2> 2752011 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 2752012 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2752013 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2752013 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2752014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2752014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7f015d90{/solr,null,AVAILABLE}
   [junit4]   2> 2752014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@3822b4ff{HTTP/1.1,[http/1.1]}{127.0.0.1:64497}
   [junit4]   2> 2752014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server Started @2752094ms
   [junit4]   2> 2752014 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64496}
   [junit4]   2> 2752015 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2752015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2752015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2752015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2752015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2752015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:13.064Z
   [junit4]   2> 2752017 INFO  (zkConnectionManagerCallback-8849-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2752018 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2752031 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2752032 INFO  (zkConnectionManagerCallback-8853-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2752036 INFO  (zkConnectionManagerCallback-8855-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2752048 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 2752053 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2752056 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2752057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64496_solr
   [junit4]   2> 2752059 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8834-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8803-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2752059 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753117 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64496.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2753122 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64496.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2753123 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64496.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2753124 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node4/.
   [junit4]   2> 2753128 INFO  (zkConnectionManagerCallback-8862-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2753130 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2753132 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64496_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2753209 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:64497/solr. Proxy: http://127.0.0.1:64496/solr
   [junit4]   2> 2753210 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@46cfcab5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2753210 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1846333307
   [junit4]   2> 2753214 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 2753214 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@33607eac: rootName = 
solr_64474, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@47cadc
   [junit4]   2> 2753227 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 2753227 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@2494bc67: rootName = 
solr_64474, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@66062815
   [junit4]   2> 2753234 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 2753234 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3a3e8c19: rootName = 
solr_64474, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@565ab647
   [junit4]   2> 2753240 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64474_solr
   [junit4]   2> 2753243 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8834-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8803-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753244 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2753246 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 2753246 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 2753251 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@174c60b6{/solr,null,UNAVAILABLE}
   [junit4]   2> 2753251 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 2753253 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2753254 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2753254 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2753254 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2753254 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6446ccac{/solr,null,AVAILABLE}
   [junit4]   2> 2753254 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@6bb957a1{HTTP/1.1,[http/1.1]}{127.0.0.1:64505}
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server Started @2753334ms
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64502}
   [junit4]   2> 2753255 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2753255 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:14.304Z
   [junit4]   2> 2753257 INFO  (zkConnectionManagerCallback-8864-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2753258 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2753278 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2753280 INFO  (zkConnectionManagerCallback-8868-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2753283 INFO  (zkConnectionManagerCallback-8870-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2753296 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 2753300 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2753304 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2753304 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64502_solr
   [junit4]   2> 2753306 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2753307 INFO  (zkCallback-8869-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754015 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64502.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2754024 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64502.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2754024 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64502.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2754025 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node2/.
   [junit4]   2> 2754031 INFO  (zkConnectionManagerCallback-8877-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2754033 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2754034 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64502_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2754087 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:64505/solr. Proxy: http://127.0.0.1:64502/solr
   [junit4]   2> 2754088 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@7b2b14eb{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2754088 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1263760475
   [junit4]   2> 2754088 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 2754088 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@aa2be45: rootName = 
solr_64479, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@23d0d3ec
   [junit4]   2> 2754095 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 2754095 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@3730191: rootName = 
solr_64479, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@66062815
   [junit4]   2> 2754098 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 2754098 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4a869088: rootName = 
solr_64479, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@565ab647
   [junit4]   2> 2754101 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64479_solr
   [junit4]   2> 2754104 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8809-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8869-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8824-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8876-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754104 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2754106 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 2754106 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72070031171125259-127.0.0.1:64479_solr-n_0000000000) closing
   [junit4]   2> 2754107 INFO  
(OverseerStateUpdate-72070031171125259-127.0.0.1:64479_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:64479_solr
   [junit4]   2> 2754108 WARN  
(OverseerAutoScalingTriggerThread-72070031171125259-127.0.0.1:64479_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 2754112 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64477_solr
   [junit4]   2> 2754113 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@432829be{/solr,null,UNAVAILABLE}
   [junit4]   2> 2754113 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 2754114 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2754114 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72070031171125260-127.0.0.1:64477_solr-n_0000000002) starting
   [junit4]   2> 2754116 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2754116 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2754116 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2754116 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2ed93a1b{/solr,null,AVAILABLE}
   [junit4]   2> 2754117 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@23efbac3{HTTP/1.1,[http/1.1]}{127.0.0.1:64511}
   [junit4]   2> 2754117 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server Started @2754196ms
   [junit4]   2> 2754117 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64510}
   [junit4]   2> 2754117 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2754118 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2754118 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2754118 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2754118 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2754118 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:15.167Z
   [junit4]   2> 2754120 INFO  (zkConnectionManagerCallback-8879-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2754121 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2754140 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2754142 INFO  (zkConnectionManagerCallback-8883-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2754145 INFO  (zkConnectionManagerCallback-8885-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2754158 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 2754162 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2754168 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2754168 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64510_solr
   [junit4]   2> 2754172 INFO  (zkCallback-8884-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8869-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8876-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2754172 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755284 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64510.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2755294 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64510.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2755294 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64510.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2755295 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node1/.
   [junit4]   2> 2755317 INFO  (zkConnectionManagerCallback-8892-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2755318 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2755333 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64510_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2755429 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:64511/solr. Proxy: http://127.0.0.1:64510/solr
   [junit4]   2> 2755430 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Stopped 
ServerConnector@1f7962a0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2755430 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.CoreContainer Shutting down CoreContainer instance=731931339
   [junit4]   2> 2755431 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 2755431 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@50089e5d: rootName = 
solr_64477, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@19d6352f
   [junit4]   2> 2755438 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 2755438 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@326254ac: rootName = 
solr_64477, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@66062815
   [junit4]   2> 2755451 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 2755451 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1ec56b78: rootName = 
solr_64477, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@565ab647
   [junit4]   2> 2755454 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64477_solr
   [junit4]   2> 2755457 INFO  (zkCallback-8884-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8869-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8811-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8839-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8876-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755457 INFO  (zkCallback-8891-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2755459 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 2755459 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 2755459 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.Overseer Overseer 
(id=72070031171125260-127.0.0.1:64477_solr-n_0000000002) closing
   [junit4]   2> 2755459 INFO  
(OverseerStateUpdate-72070031171125260-127.0.0.1:64477_solr-n_0000000002) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:64477_solr
   [junit4]   2> 2755461 WARN  
(OverseerAutoScalingTriggerThread-72070031171125260-127.0.0.1:64477_solr-n_0000000002)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 2755465 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@753cf76b{/solr,null,UNAVAILABLE}
   [junit4]   2> 2755465 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 2755465 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64496_solr
   [junit4]   2> 2755466 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T21:27:37Z, 
git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2755467 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72070031171125269-127.0.0.1:64496_solr-n_0000000004) starting
   [junit4]   2> 2755468 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2755468 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2755468 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 2755469 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6bac9827{/solr,null,AVAILABLE}
   [junit4]   2> 2755469 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4e2a3c0a{HTTP/1.1,[http/1.1]}{127.0.0.1:64517}
   [junit4]   2> 2755469 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.e.j.s.Server Started @2755549ms
   [junit4]   2> 2755469 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=64516}
   [junit4]   2> 2755469 ERROR 
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2755470 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2755470 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.4.0
   [junit4]   2> 2755470 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2755470 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2755470 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-05-06T11:01:16.519Z
   [junit4]   2> 2755472 INFO  (zkConnectionManagerCallback-8894-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2755473 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2755524 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64472/solr
   [junit4]   2> 2755525 INFO  (zkConnectionManagerCallback-8898-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2755528 INFO  (zkConnectionManagerCallback-8900-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2755544 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 2755548 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2755552 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 2755552 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:64516_solr
   [junit4]   2> 2755554 INFO  (zkCallback-8869-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8854-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8846-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8861-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8884-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8876-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755554 INFO  (zkCallback-8899-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2755555 INFO  (zkCallback-8891-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2756038 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64516.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2756047 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64516.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2756047 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_64516.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@7032ba04
   [junit4]   2> 2756048 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_DC70601A2BC5FAC6-001/tempDir-001/node3/.
   [junit4]   2> 2756054 INFO  (zkConnectionManagerCallback-8907-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2756057 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 2756060 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) 
[n:127.0.0.1:64516_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:64472/solr ready
   [junit4]   2> 2756155 INFO  
(SUITE-TestPullReplicaErrorHandling-seed#[DC70601A2BC5FAC6]-worker) [    ] 
o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: 
http://127.0.0.1:64517/solr. Proxy: http://127.0.0.1:64516/solr
   [junit4]   2> 2756156 INFO  (SocketProxy-Acceptor-64496) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=64522,localport=64496], receiveBufferSize:408300
   [junit4]   2> 2756156 INFO  (SocketProxy-Acceptor-64496) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=64497,localport=64523], receiveBufferSize=408300
   [junit4]   2> 2756158 INFO  (qtp2126395988-27089) [n:127.0.0.1:64496_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with 
params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and 
sendToOCPQueue=true
   [junit4]   2> 2756160 INFO  (qtp2126395988-27089) [n:127.0.0.1:64496_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} 
status=0 QTime=2
   [junit4]   2> 2756243 INFO  (qtp2126395988-27091) [n:127.0.0.1:64496_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
pullReplicas=1&replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=pull_replica_error_handling_test_cant_connect_to_pull_replica&nrtReplicas=1&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 2756252 INFO  (OverseerThreadFactory-10790-thread-1) [    ] 
o.a.s.c.a.c.CreateCollectionCmd Create collection 
pull_replica_error_handling_test_cant_connect_to_pull_replica
   [junit4]   2> 2756388 INFO  
(OverseerStateUpdate-72070031171125269-127.0.0.1:64496_solr-n_0000000004) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   
"collection":"pull_replica_error_handling_test_cant_connect_to_pull_replica",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   
"core":"pull_replica_error_handling_test_cant_connect_to_pull_replica_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:64516/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2756416 INFO  
(OverseerStateUpdate-72070031171125269-127.0.0.1:64496_solr-n_0000000004) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   
"collection":"pull_replica_error_handling_test_cant_connect_to_pull_replica",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   
"core":"pull_replica_error_handling_test_cant_connect_to_pull_replica_shard1_replica_p2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:64510/solr";,
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2756422 INFO  
(OverseerStateUpdate-72070031171125269-127.0.0.1:64496_solr-n_0000000004) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   
"collection":"pull_replica_error_handling_test_cant_connect_to_pull_replica",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   
"core":"pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:64502/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2756435 INFO  
(OverseerStateUpdate-72070031171125269-127.0.0.1:64496_solr-n_0000000004) [    
] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   
"collection":"pull_replica_error_handling_test_cant_connect_to_pull_replica",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   
"core":"pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_p6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:64496/solr";,
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2756645 INFO  (SocketProxy-Acceptor-64516) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=64525,localport=64516], receiveBufferSize:408300
   [junit4]   2> 2756646 INFO  (SocketProxy-Acceptor-64510) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=64526,localport=64510], receiveBufferSize:408300
   [junit4]   2> 2756646 INFO  (SocketProxy-Acceptor-64502) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=64527,localport=64502], receiveBufferSize:408300
   [junit4]   2> 2756646 INFO  (SocketProxy-Acceptor-64516) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=64517,localport=64528], receiveBufferSize=408300
   [junit4]   2> 2756646 INFO  (SocketProxy-Acceptor-64496) [    ] 
o.a.s.c.SocketProxy accepted 
Socket[addr=/127.0.0.1,port=64531,localport=64496], receiveBufferSize:408300
   [junit4]   2> 2756647 INFO  (SocketProxy-Acceptor-64502) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=64505,localport=64530], receiveBufferSize=408300
   [junit4]   2> 2756647 INFO  (SocketProxy-Acceptor-64510) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=64511,localport=64529], receiveBufferSize=408300
   [junit4]   2> 2756647 INFO  (SocketProxy-Acceptor-64496) [    ] 
o.a.s.c.SocketProxy proxy connection 
Socket[addr=/127.0.0.1,port=64497,localport=64532], receiveBufferSize=408300
   [junit4]   2> 2756648 INFO  (qtp2126395988-27094) [n:127.0.0.1:64496_solr    
x:pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_p6]
 o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_p6&action=CREATE&numShards=2&collection=pull_replica_error_handling_test_cant_connect_to_pull_replica&shard=shard2&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 2756648 INFO  (qtp2135967700-27118) [n:127.0.0.1:64502_solr    
x:pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_n4]
 o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=pull_replica_error_handling_test_cant_connect_to_pull_replica_shard2_replica_n4&action=CREATE&numShards=2&collection=pull_replica_error_handling_test_cant_connect_to_pull_replica&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2756648 INFO  (qtp1318899281-27186) [n:127.0.0.1:64516_solr    
x:pull_replica_error_handling_test_cant_connect_to_pull_replica_sha

[...truncated too long message...]

2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: 
org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath]         confs: [default]
[ivy:cachepath]         found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 20ms :: artifacts dl 1ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
        ---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: DC70601A2BC5FAC6
    [mkdir] Created dir: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says ¡Hola! Master seed: DC70601A2BC5FAC6
   [junit4] Executing 5 suites with 2 JVMs.
   [junit4] 
   [junit4] Started J1 PID([email protected]).
   [junit4] Started J0 PID([email protected]).
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      21.5s J1 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      58.0s J1 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] OK      11.2s J1 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] Completed [1/5] on J1 in 120.81s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      20.7s J0 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      57.4s J0 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] OK      17.8s J0 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] Completed [2/5] on J0 in 126.04s, 3 tests
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: 
org.apache.solr.cloud.TestPullReplicaErrorHandling. This may confuse tools that 
process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      10.6s J1 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      57.7s J1 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] OK      7.94s J1 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] Completed [3/5] on J1 in 85.31s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      10.4s J0 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      57.8s J0 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] OK      16.9s J0 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] Completed [4/5] on J0 in 94.67s, 3 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4] OK      9.47s J1 | 
TestPullReplicaErrorHandling.testCantConnectToPullReplica
   [junit4] OK      58.7s J1 | 
TestPullReplicaErrorHandling.testCantConnectToLeader
   [junit4] OK      17.5s J1 | 
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
   [junit4] Completed [5/5] on J1 in 94.05s, 3 tests
   [junit4] 
   [junit4] JVM J0:     1.11 ..   223.84 =   222.74s
   [junit4] JVM J1:     1.09 ..   304.30 =   303.21s
   [junit4] Execution time total: 5 minutes 4 seconds
   [junit4] Tests summary: 5 suites, 15 tests
   [junit4] Could not remove temporary path: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0 
(java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: 
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1 
(java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 596.23s | org.apache.solr.cloud.BasicDistributedZkTest
[junit4:tophints] 281.43s | org.apache.solr.cloud.TestPullReplicaErrorHandling
[junit4:tophints] 221.96s | org.apache.solr.update.TestInPlaceUpdatesDistrib
[junit4:tophints] 188.55s | 
org.apache.solr.cloud.autoscaling.SearchRateTriggerIntegrationTest
[junit4:tophints] 177.89s | 
org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 5 minutes 8 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.TestPullReplicaErrorHandling
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2662)
        at hudson.FilePath$34.invoke(FilePath.java:2541)
        at hudson.FilePath$34.invoke(FilePath.java:2531)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2902)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to MacOSX VBOX
                at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at 
hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1021)
                at hudson.FilePath.act(FilePath.java:1010)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2531)
                at 
hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at 
hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at 
hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2904)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no 
matches found within 10000
        at hudson.FilePath.act(FilePath.java:1023)
        at hudson.FilePath.act(FilePath.java:1010)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2531)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern 
"**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=2558a06f3c8040d47de6606da2539532e4c67854, 
workspace=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX
[WARNINGS] Computing warning deltas based on reference build #618
Recording test results
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to