Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1132/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
4 threads leaked from SUITE scope at 
org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) 
Thread[id=18069, name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         
at java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)    
2) Thread[id=18070, name=jetty-launcher-3587-thread-1-EventThread, 
state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)    
3) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         
at java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)    
4) Thread[id=18068, name=jetty-launcher-3587-thread-2-EventThread, 
state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE 
scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=18069, 
name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   2) Thread[id=18070, name=jetty-launcher-3587-thread-1-EventThread, 
state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   3) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   4) Thread[id=18068, name=jetty-launcher-3587-thread-2-EventThread, 
state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
        at __randomizedtesting.SeedInfo.seed([B79C532C180EBE29]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=18069, name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         
at java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)    
2) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         
at java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=18069, 
name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   2) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
        at __randomizedtesting.SeedInfo.seed([B79C532C180EBE29]:0)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
No live SolrServers available to handle this 
request:[https://127.0.0.1:36821/solr/MoveReplicaHDFSTest_failed_coll_true, 
https://127.0.0.1:43505/solr/MoveReplicaHDFSTest_failed_coll_true]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this 
request:[https://127.0.0.1:36821/solr/MoveReplicaHDFSTest_failed_coll_true, 
https://127.0.0.1:43505/solr/MoveReplicaHDFSTest_failed_coll_true]
        at 
__randomizedtesting.SeedInfo.seed([B79C532C180EBE29:1D5180DEAFDD6BF9]:0)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
        at 
org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:306)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at 
https://127.0.0.1:36821/solr/MoveReplicaHDFSTest_failed_coll_true: no servers 
hosting shard: shard1
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
        ... 46 more




Build Log:
[...truncated 13439 lines...]
   [junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
   [junit4]   2> 1685790 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/init-core-data-001
   [junit4]   2> 1685791 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=37 numCloses=37
   [junit4]   2> 1685791 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1685793 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1685794 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001
   [junit4]   2> 1685794 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1685794 INFO  (Thread-3191) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1685794 INFO  (Thread-3191) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1685796 ERROR (Thread-3191) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1685894 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:37399
   [junit4]   2> 1685897 INFO  (zkConnectionManagerCallback-3186-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685903 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1685903 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1685903 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1685904 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1685905 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@280549b9{/solr,null,AVAILABLE}
   [junit4]   2> 1685905 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7dc84c28{/solr,null,AVAILABLE}
   [junit4]   2> 1685906 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4a80d743{/solr,null,AVAILABLE}
   [junit4]   2> 1685906 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@593857bc{/solr,null,AVAILABLE}
   [junit4]   2> 1685909 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@16f296a1{SSL,[ssl, 
http/1.1]}{127.0.0.1:37881}
   [junit4]   2> 1685909 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@d865961{SSL,[ssl, 
http/1.1]}{127.0.0.1:42311}
   [junit4]   2> 1685909 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.e.j.s.Server Started @1687632ms
   [junit4]   2> 1685909 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.e.j.s.Server Started @1687632ms
   [junit4]   2> 1685909 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37881}
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=42311}
   [junit4]   2> 1685910 ERROR (jetty-launcher-3183-thread-3) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1685910 ERROR (jetty-launcher-3183-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-06T16:52:17.811Z
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-06T16:52:17.811Z
   [junit4]   2> 1685910 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@5170c2fd{SSL,[ssl, 
http/1.1]}{127.0.0.1:43505}
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.e.j.s.Server Started @1687633ms
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=43505}
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@6786d610{SSL,[ssl, 
http/1.1]}{127.0.0.1:44785}
   [junit4]   2> 1685911 ERROR (jetty-launcher-3183-thread-4) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.e.j.s.Server Started @1687634ms
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=44785}
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1685911 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1685912 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-06T16:52:17.813Z
   [junit4]   2> 1685912 ERROR (jetty-launcher-3183-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1685912 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1685912 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1685912 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1685912 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-06T16:52:17.813Z
   [junit4]   2> 1685918 INFO  (zkConnectionManagerCallback-3189-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685919 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1685919 INFO  (zkConnectionManagerCallback-3194-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685920 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1685922 INFO  (zkConnectionManagerCallback-3190-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685923 INFO  (zkConnectionManagerCallback-3192-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685932 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1685932 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1685935 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x160cc6324a00003, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1685939 INFO  (jetty-launcher-3183-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
   [junit4]   2> 1685939 INFO  (jetty-launcher-3183-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
   [junit4]   2> 1685940 INFO  (jetty-launcher-3183-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
   [junit4]   2> 1685941 INFO  (zkConnectionManagerCallback-3201-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685941 INFO  (zkConnectionManagerCallback-3203-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685941 INFO  (zkConnectionManagerCallback-3206-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685943 INFO  (jetty-launcher-3183-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
   [junit4]   2> 1685943 INFO  
(zkConnectionManagerCallback-3209-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685943 INFO  
(zkConnectionManagerCallback-3212-thread-1-processing-n:127.0.0.1:43505_solr) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685944 INFO  (zkConnectionManagerCallback-3214-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685946 INFO  
(zkConnectionManagerCallback-3216-thread-1-processing-n:127.0.0.1:37881_solr) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685946 INFO  
(zkConnectionManagerCallback-3218-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1685961 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1685962 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1685962 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:42311_solr
   [junit4]   2> 1685963 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:43505_solr
   [junit4]   2> 1685963 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.Overseer Overseer 
(id=99303917990445068-127.0.0.1:42311_solr-n_0000000000) starting
   [junit4]   2> 1685964 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 1685965 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1685967 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:44785_solr
   [junit4]   2> 1685971 INFO  
(zkCallback-3217-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1685975 INFO  
(zkCallback-3211-thread-1-processing-n:127.0.0.1:43505_solr) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 1685975 INFO  
(zkCallback-3208-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 1685982 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:42311_solr
   [junit4]   2> 1685982 INFO  
(zkCallback-3208-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1685982 INFO  
(zkCallback-3217-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1685994 INFO  
(zkCallback-3211-thread-1-processing-n:127.0.0.1:43505_solr) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 1686000 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 1686001 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1686002 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37881_solr
   [junit4]   2> 1686002 INFO  
(zkCallback-3208-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1686002 INFO  
(zkCallback-3211-thread-1-processing-n:127.0.0.1:43505_solr) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1686002 INFO  
(zkCallback-3217-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1686003 INFO  
(zkCallback-3215-thread-1-processing-n:127.0.0.1:37881_solr) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 1686016 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44785.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686018 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43505.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686022 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44785.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686023 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_44785.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686024 INFO  (jetty-launcher-3183-thread-1) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node1/.
   [junit4]   2> 1686028 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43505.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686028 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_43505.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686029 INFO  (jetty-launcher-3183-thread-4) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node4/.
   [junit4]   2> 1686042 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37881.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686043 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42311.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686052 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37881.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686053 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37881.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686053 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42311.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686053 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_42311.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1686053 INFO  (jetty-launcher-3183-thread-3) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node3/.
   [junit4]   2> 1686054 INFO  (jetty-launcher-3183-thread-2) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node2/.
   [junit4]   2> 1686101 INFO  (zkConnectionManagerCallback-3228-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1686102 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x160cc6324a0000d, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1686103 INFO  (zkConnectionManagerCallback-3232-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1686104 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1686104 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37399/solr ready
   [junit4]   2> 1686117 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1686120 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=3
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1686173 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1686186 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1686189 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 1686204 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_localdomain_35639_hdfs____us37tg/webapp
   [junit4]   2> 1686669 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:35639
   [junit4]   2> 1686766 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1686767 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 1686776 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_42323_datanode____.v9dmeb/webapp
   [junit4]   2> 1687198 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42323
   [junit4]   2> 1687248 WARN  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1687249 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 1687257 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Extract 
jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_35061_datanode____.zg1lxs/webapp
   [junit4]   2> 1687324 ERROR (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-002/hdfsBaseDir/data/data1/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-002/hdfsBaseDir/data/data2/]]
  heartbeating to localhost.localdomain/127.0.0.1:43321) [    ] 
o.a.h.h.s.d.DirectoryScanner 
dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 
ms/sec. Assuming default value of 1000
   [junit4]   2> 1687332 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0xa82e7a629df6b: from storage 
DS-ff7c4f6c-7fc5-43dc-8e77-31dfbe544d03 node 
DatanodeRegistration(127.0.0.1:41817, 
datanodeUuid=cc26d0cb-0119-4d0b-aa43-10f6ff6f6fd1, infoPort=36495, 
infoSecurePort=0, ipcPort=44013, 
storageInfo=lv=-56;cid=testClusterID;nsid=1978091092;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 1687332 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0xa82e7a629df6b: from storage 
DS-6d96032e-7410-4895-9971-22341b7e5b5c node 
DatanodeRegistration(127.0.0.1:41817, 
datanodeUuid=cc26d0cb-0119-4d0b-aa43-10f6ff6f6fd1, infoPort=36495, 
infoSecurePort=0, ipcPort=44013, 
storageInfo=lv=-56;cid=testClusterID;nsid=1978091092;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 1687719 INFO  
(SUITE-MoveReplicaHDFSTest-seed#[B79C532C180EBE29]-worker) [    ] o.m.log 
Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35061
   [junit4]   2> 1687901 ERROR (DataNode: 
[[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-002/hdfsBaseDir/data/data3/,
 
[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-002/hdfsBaseDir/data/data4/]]
  heartbeating to localhost.localdomain/127.0.0.1:43321) [    ] 
o.a.h.h.s.d.DirectoryScanner 
dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 
ms/sec. Assuming default value of 1000
   [junit4]   2> 1687909 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0xa82e7c88c04d9: from storage 
DS-aa4028c3-bec7-452b-877f-bf8d8598f978 node 
DatanodeRegistration(127.0.0.1:39203, 
datanodeUuid=c1dec438-2758-4536-8807-b0ccbe7ebf91, infoPort=42993, 
infoSecurePort=0, ipcPort=41003, 
storageInfo=lv=-56;cid=testClusterID;nsid=1978091092;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 1 msecs
   [junit4]   2> 1687909 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* processReport 0xa82e7c88c04d9: from storage 
DS-c53e32ec-6a56-46f8-85f0-a04f8eefa074 node 
DatanodeRegistration(127.0.0.1:39203, 
datanodeUuid=c1dec438-2758-4536-8807-b0ccbe7ebf91, infoPort=42993, 
infoSecurePort=0, ipcPort=41003, 
storageInfo=lv=-56;cid=testClusterID;nsid=1978091092;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 1688058 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1688059 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1688061 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] o.e.j.s.Server 
jetty-9.3.20.v20170531
   [junit4]   2> 1688062 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6bb2734e{/solr,null,AVAILABLE}
   [junit4]   2> 1688062 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@6b9b53dc{SSL,[ssl, 
http/1.1]}{127.0.0.1:36821}
   [junit4]   2> 1688063 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] o.e.j.s.Server 
Started @1689786ms
   [junit4]   2> 1688063 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36821}
   [junit4]   2> 1688063 ERROR 
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 1688064 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
7.3.0
   [junit4]   2> 1688064 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1688064 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1688064 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-06T16:52:19.965Z
   [junit4]   2> 1688065 INFO  (zkConnectionManagerCallback-3235-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1688065 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1688072 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
   [junit4]   2> 1688073 INFO  (zkConnectionManagerCallback-3239-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1688075 INFO  
(zkConnectionManagerCallback-3241-thread-1-processing-n:127.0.0.1:36821_solr) 
[n:127.0.0.1:36821_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1688080 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1688080 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1688081 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36821_solr
   [junit4]   2> 1688082 INFO  
(zkCallback-3211-thread-1-processing-n:127.0.0.1:43505_solr) 
[n:127.0.0.1:43505_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 1688082 INFO  
(zkCallback-3208-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 1688083 INFO  (zkCallback-3231-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1688082 INFO  
(zkCallback-3217-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 1688082 INFO  
(zkCallback-3215-thread-1-processing-n:127.0.0.1:37881_solr) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 1688084 INFO  
(zkCallback-3240-thread-1-processing-n:127.0.0.1:36821_solr) 
[n:127.0.0.1:36821_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 1688084 INFO  (zkCallback-3231-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1688132 INFO  
(OverseerCollectionConfigSetProcessor-99303917990445068-127.0.0.1:42311_solr-n_0000000000)
 [n:127.0.0.1:42311_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 1688142 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36821.solr.node' 
(registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1688148 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36821.solr.jvm' 
(registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1688148 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36821.solr.jetty' 
(registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1688148 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [n:127.0.0.1:36821_solr 
   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node5/.
   [junit4]   2> 1688182 INFO  (zkConnectionManagerCallback-3245-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1688183 INFO  
(TEST-MoveReplicaHDFSTest.test-seed#[B79C532C180EBE29]) [    ] 
o.a.s.c.MoveReplicaTest total_jettys: 5
   [junit4]   2> 1688194 INFO  (qtp710071632-14906) [n:127.0.0.1:36821_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
replicationFactor=2&collection.configName=conf1&maxShardsPerNode=2&autoAddReplicas=false&name=MoveReplicaHDFSTest_coll_true&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 1688195 INFO  
(OverseerThreadFactory-6391-thread-2-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.CreateCollectionCmd Create collection 
MoveReplicaHDFSTest_coll_true
   [junit4]   2> 1688302 INFO  
(OverseerStateUpdate-99303917990445068-127.0.0.1:42311_solr-n_0000000000) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MoveReplicaHDFSTest_coll_true",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"MoveReplicaHDFSTest_coll_true_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36821/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1688303 INFO  
(OverseerStateUpdate-99303917990445068-127.0.0.1:42311_solr-n_0000000000) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MoveReplicaHDFSTest_coll_true",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"MoveReplicaHDFSTest_coll_true_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37881/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1688305 INFO  
(OverseerStateUpdate-99303917990445068-127.0.0.1:42311_solr-n_0000000000) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MoveReplicaHDFSTest_coll_true",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"MoveReplicaHDFSTest_coll_true_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42311/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1688306 INFO  
(OverseerStateUpdate-99303917990445068-127.0.0.1:42311_solr-n_0000000000) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"MoveReplicaHDFSTest_coll_true",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"MoveReplicaHDFSTest_coll_true_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44785/solr";,
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1688513 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_true_shard1_replica_n2&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_true&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1688513 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_true_shard1_replica_n1&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_true&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1688513 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1688513 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1688549 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr    ] 
o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_true_shard2_replica_n6&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_true&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1688550 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr    ] 
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 
transient cores
   [junit4]   2> 1688550 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr    
] o.a.s.h.a.CoreAdminOperation core create command 
qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=MoveReplicaHDFSTest_coll_true_shard2_replica_n4&action=CREATE&numShards=2&collection=MoveReplicaHDFSTest_coll_true&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1688551 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 1688655 INFO  
(zkCallback-3215-thread-1-processing-n:127.0.0.1:37881_solr) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3208-thread-1-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3215-thread-2-processing-n:127.0.0.1:37881_solr) 
[n:127.0.0.1:37881_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3240-thread-2-processing-n:127.0.0.1:36821_solr) 
[n:127.0.0.1:36821_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3208-thread-2-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3217-thread-1-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3240-thread-1-processing-n:127.0.0.1:36821_solr) 
[n:127.0.0.1:36821_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1688655 INFO  
(zkCallback-3217-thread-2-processing-n:127.0.0.1:42311_solr) 
[n:127.0.0.1:42311_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1689530 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.3.0
   [junit4]   2> 1689530 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.3.0
   [junit4]   2> 1689541 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.s.IndexSchema 
[MoveReplicaHDFSTest_coll_true_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1689541 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.s.IndexSchema 
[MoveReplicaHDFSTest_coll_true_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1689546 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1689546 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1689546 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.CoreContainer 
Creating SolrCore 'MoveReplicaHDFSTest_coll_true_shard1_replica_n1' using 
configuration from collection MoveReplicaHDFSTest_coll_true, trusted=true
   [junit4]   2> 1689546 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.CoreContainer 
Creating SolrCore 'MoveReplicaHDFSTest_coll_true_shard1_replica_n2' using 
configuration from collection MoveReplicaHDFSTest_coll_true, trusted=true
   [junit4]   2> 1689547 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter 
JMX monitoring for 
'solr_36821.solr.core.MoveReplicaHDFSTest_coll_true.shard1.replica_n1' 
(registry 'solr.core.MoveReplicaHDFSTest_coll_true.shard1.replica_n1') enabled 
at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1689547 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter 
JMX monitoring for 
'solr_37881.solr.core.MoveReplicaHDFSTest_coll_true.shard1.replica_n2' 
(registry 'solr.core.MoveReplicaHDFSTest_coll_true.shard1.replica_n2') enabled 
at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1689552 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:43321/data
   [junit4]   2> 1689552 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory 
Solr Kerberos Authentication disabled
   [junit4]   2> 1689552 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1689553 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:43321/data
   [junit4]   2> 1689553 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.SolrCore 
[[MoveReplicaHDFSTest_coll_true_shard1_replica_n1] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node5/MoveReplicaHDFSTest_coll_true_shard1_replica_n1],
 
dataDir=[hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node3/data/]
   [junit4]   2> 1689553 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory 
Solr Kerberos Authentication disabled
   [junit4]   2> 1689553 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1689553 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.SolrCore 
[[MoveReplicaHDFSTest_coll_true_shard1_replica_n2] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node3/MoveReplicaHDFSTest_coll_true_shard1_replica_n2],
 
dataDir=[hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node5/data/]
   [junit4]   2> 1689555 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node3/data/snapshot_metadata
   [junit4]   2> 1689555 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node5/data/snapshot_metadata
   [junit4]   2> 1689558 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.3.0
   [junit4]   2> 1689559 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 7.3.0
   [junit4]   2> 1689576 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.s.IndexSchema 
[MoveReplicaHDFSTest_coll_true_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 1689576 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.s.IndexSchema 
[MoveReplicaHDFSTest_coll_true_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 1689577 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1689577 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.s.IndexSchema Loaded 
schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1689577 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.CoreContainer 
Creating SolrCore 'MoveReplicaHDFSTest_coll_true_shard2_replica_n6' using 
configuration from collection MoveReplicaHDFSTest_coll_true, trusted=true
   [junit4]   2> 1689577 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.CoreContainer 
Creating SolrCore 'MoveReplicaHDFSTest_coll_true_shard2_replica_n4' using 
configuration from collection MoveReplicaHDFSTest_coll_true, trusted=true
   [junit4]   2> 1689578 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter 
JMX monitoring for 
'solr_42311.solr.core.MoveReplicaHDFSTest_coll_true.shard2.replica_n4' 
(registry 'solr.core.MoveReplicaHDFSTest_coll_true.shard2.replica_n4') enabled 
at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1689578 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter 
JMX monitoring for 
'solr_44785.solr.core.MoveReplicaHDFSTest_coll_true.shard2.replica_n6' 
(registry 'solr.core.MoveReplicaHDFSTest_coll_true.shard2.replica_n6') enabled 
at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f8d82f9
   [junit4]   2> 1689578 WARN  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1689578 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:43321/data
   [junit4]   2> 1689578 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost.localdomain:43321/data
   [junit4]   2> 1689578 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory 
Solr Kerberos Authentication disabled
   [junit4]   2> 1689578 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory 
Solr Kerberos Authentication disabled
   [junit4]   2> 1689578 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1689578 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.SolrCore 
solr.RecoveryStrategy.Builder
   [junit4]   2> 1689578 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.SolrCore 
[[MoveReplicaHDFSTest_coll_true_shard2_replica_n4] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node2/MoveReplicaHDFSTest_coll_true_shard2_replica_n4],
 
dataDir=[hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node7/data/]
   [junit4]   2> 1689578 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.SolrCore 
[[MoveReplicaHDFSTest_coll_true_shard2_replica_n6] ] Opening new SolrCore at 
[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_B79C532C180EBE29-001/tempDir-001/node1/MoveReplicaHDFSTest_coll_true_shard2_replica_n6],
 
dataDir=[hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node8/data/]
   [junit4]   2> 1689578 WARN  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1689579 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node7/data/snapshot_metadata
   [junit4]   2> 1689579 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node8/data/snapshot_metadata
   [junit4]   2> 1689585 WARN  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1689585 WARN  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1694579 WARN  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1694579 WARN  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1694585 WARN  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1694585 WARN  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.s.h.HdfsDirectory The 
NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 1699616 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node5/data
   [junit4]   2> 1699621 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node3/data
   [junit4]   2> 1699622 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node7/data
   [junit4]   2> 1699625 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node8/data
   [junit4]   2> 1699649 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node3/data/index
   [junit4]   2> 1699649 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node5/data/index
   [junit4]   2> 1699652 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node7/data/index
   [junit4]   2> 1699652 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory 
creating directory factory for path 
hdfs://localhost.localdomain:43321/data/MoveReplicaHDFSTest_coll_true/core_node8/data/index
   [junit4]   2> 1699719 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39203 is added to 
blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-ff7c4f6c-7fc5-43dc-8e77-31dfbe544d03:NORMAL:127.0.0.1:41817|RBW],
 
ReplicaUC[[DISK]DS-c53e32ec-6a56-46f8-85f0-a04f8eefa074:NORMAL:127.0.0.1:39203|RBW]]}
 size 0
   [junit4]   2> 1699723 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41817 is added to 
blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-aa4028c3-bec7-452b-877f-bf8d8598f978:NORMAL:127.0.0.1:39203|RBW],
 
ReplicaUC[[DISK]DS-ff7c4f6c-7fc5-43dc-8e77-31dfbe544d03:NORMAL:127.0.0.1:41817|FINALIZED]]}
 size 0
   [junit4]   2> 1699728 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39203 is added to 
blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-aa4028c3-bec7-452b-877f-bf8d8598f978:NORMAL:127.0.0.1:39203|RBW],
 
ReplicaUC[[DISK]DS-6d96032e-7410-4895-9971-22341b7e5b5c:NORMAL:127.0.0.1:41817|RBW]]}
 size 0
   [junit4]   2> 1699730 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41817 is added to 
blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-ff7c4f6c-7fc5-43dc-8e77-31dfbe544d03:NORMAL:127.0.0.1:41817|RBW],
 
ReplicaUC[[DISK]DS-c53e32ec-6a56-46f8-85f0-a04f8eefa074:NORMAL:127.0.0.1:39203|RBW]]}
 size 0
   [junit4]   2> 1699731 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39203 is added to 
blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-aa4028c3-bec7-452b-877f-bf8d8598f978:NORMAL:127.0.0.1:39203|RBW],
 
ReplicaUC[[DISK]DS-ff7c4f6c-7fc5-43dc-8e77-31dfbe544d03:NORMAL:127.0.0.1:41817|FINALIZED]]}
 size 0
   [junit4]   2> 1699734 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41817 is added to 
blk_1073741826_1002 size 69
   [junit4]   2> 1699736 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39203 is added to 
blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-6d96032e-7410-4895-9971-22341b7e5b5c:NORMAL:127.0.0.1:41817|RBW],
 
ReplicaUC[[DISK]DS-c53e32ec-6a56-46f8-85f0-a04f8eefa074:NORMAL:127.0.0.1:39203|RBW]]}
 size 0
   [junit4]   2> 1699737 INFO  (Block report processor) [    ] BlockStateChange 
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:41817 is added to 
blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-6d96032e-7410-4895-9971-22341b7e5b5c:NORMAL:127.0.0.1:41817|RBW],
 
ReplicaUC[[DISK]DS-c53e32ec-6a56-46f8-85f0-a04f8eefa074:NORMAL:127.0.0.1:39203|RBW]]}
 size 0
   [junit4]   2> 1699808 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1699808 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1699808 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1699808 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1699808 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.HdfsUpdateLog 
Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 1699808 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.HdfsUpdateLog 
Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 1699814 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1699814 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1699814 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.HdfsUpdateLog 
Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 1699815 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.UpdateHandler Using 
UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1699815 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.UpdateLog 
Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1699815 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.HdfsUpdateLog 
Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 1699819 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1699819 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1699821 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1699821 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1699823 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1699824 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1699824 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.CommitTracker Hard 
AutoCommit: disabled
   [junit4]   2> 1699825 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.CommitTracker Soft 
AutoCommit: disabled
   [junit4]   2> 1699836 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@614ec03f[MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
main]
   [junit4]   2> 1699839 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1699839 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1699841 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@3f139116[MoveReplicaHDFSTest_coll_true_shard1_replica_n2] 
main]
   [junit4]   2> 1699842 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1699842 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1699843 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@29516017[MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
main]
   [junit4]   2> 1699843 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.s.SolrIndexSearcher 
Opening [Searcher@7ecfdaf7[MoveReplicaHDFSTest_coll_true_shard2_replica_n6] 
main]
   [junit4]   2> 1699844 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1699844 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 1699844 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 1699844 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1699844 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1699845 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 1699845 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 1699845 INFO  
(searcherExecutor-6406-thread-1-processing-n:127.0.0.1:36821_solr 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1 s:shard1 
c:MoveReplicaHDFSTest_coll_true r:core_node3) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.SolrCore 
[MoveReplicaHDFSTest_coll_true_shard1_replica_n1] Registered new searcher 
Searcher@614ec03f[MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1699846 INFO  
(searcherExecutor-6409-thread-1-processing-n:127.0.0.1:42311_solr 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4 s:shard2 
c:MoveReplicaHDFSTest_coll_true r:core_node7) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.SolrCore 
[MoveReplicaHDFSTest_coll_true_shard2_replica_n4] Registered new searcher 
Searcher@29516017[MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1699847 INFO  
(searcherExecutor-6407-thread-1-processing-n:127.0.0.1:37881_solr 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2 s:shard1 
c:MoveReplicaHDFSTest_coll_true r:core_node5) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.c.SolrCore 
[MoveReplicaHDFSTest_coll_true_shard1_replica_n2] Registered new searcher 
Searcher@3f139116[MoveReplicaHDFSTest_coll_true_shard1_replica_n2] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1699847 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.h.ReplicationHandler 
Commits will be reserved for 10000ms.
   [junit4]   2> 1699848 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1588862702582759424
   [junit4]   2> 1699848 INFO  (qtp472092097-14624) [n:127.0.0.1:37881_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node5 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n2] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1588862702582759424
   [junit4]   2> 1699848 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1588862702582759424
   [junit4]   2> 1699849 INFO  
(searcherExecutor-6408-thread-1-processing-n:127.0.0.1:44785_solr 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6 s:shard2 
c:MoveReplicaHDFSTest_coll_true r:core_node8) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.c.SolrCore 
[MoveReplicaHDFSTest_coll_true_shard2_replica_n6] Registered new searcher 
Searcher@7ecfdaf7[MoveReplicaHDFSTest_coll_true_shard2_replica_n6] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1699849 INFO  (qtp64825169-14630) [n:127.0.0.1:44785_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node8 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n6] o.a.s.u.UpdateLog Could not 
find max version in index or recent updates, using new clock 1588862702583808000
   [junit4]   2> 1699852 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1699852 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1699852 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1699852 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1699852 INFO  (qtp710071632-14900) [n:127.0.0.1:36821_solr 
c:MoveReplicaHDFSTest_coll_true s:shard1 r:core_node3 
x:MoveReplicaHDFSTest_coll_true_shard1_replica_n1] o.a.s.c.SyncStrategy Sync 
replicas to 
https://127.0.0.1:36821/solr/MoveReplicaHDFSTest_coll_true_shard1_replica_n1/
   [junit4]   2> 1699852 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.c.SyncStrategy Sync 
replicas to 
https://127.0.0.1:42311/solr/MoveReplicaHDFSTest_coll_true_shard2_replica_n4/
   [junit4]   2> 1699853 INFO  (qtp342152605-14600) [n:127.0.0.1:42311_solr 
c:MoveReplicaHDFSTest_coll_true s:shard2 r:core_node7 
x:MoveReplicaHDFSTest_coll_true_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: 
core=MoveReplicaHDFSTest_coll_true_shard2_replica_n4 
url=https://127.0.0.1:42311/solr START 
replicas=[https://127.0.0.1:44785/solr/MoveReplicaHDFSTest_coll_true_shard2_replica_n6/]
 nUpdates=100
   [junit4]   2> 1699853 INFO  
(zkCallback-3208-thread-2-processing-n:127.0.0.1:44785_solr) 
[n:127.0.0.1:44785_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/MoveReplicaHDFSTest_coll_true/state.json] for collection 
[MoveReplicaHDFSTest_coll_true] has occurred - updating... (live nodes size: 
[5])
   [junit4]   2> 1699853 INFO  (zkCallback-3215-thread-2-processing-n:12

[...truncated too long message...]

Session 0x0 for server null, unexpected error, closing socket connection and 
attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native 
Method)
   [junit4]   2>        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
   [junit4]   2> Jan 06, 2018 5:00:30 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=18069, 
name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]   2>         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]   2>         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]   2>    2) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]   2>         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]   2>         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=1773, maxMBSortInHeap=6.572344097351417, 
sim=RandomSimilarity(queryNorm=false): {}, locale=da, 
timezone=America/Argentina/Buenos_Aires
   [junit4]   2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 
1.8.0_144 (64-bit)/cpus=8,threads=3,free=146150192,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: 
[PreAnalyzedUpdateProcessorTest, MissingSegmentRecoveryTest, 
TestLeaderElectionWithEmptyReplica, TestSolrFieldCacheBean, SearchHandlerTest, 
SolrXmlInZkTest, SolrGangliaReporterTest, SoftAutoCommitTest, 
CollectionsAPISolrJTest, ZkStateWriterTest, ResourceLoaderTest, 
TestFoldingMultitermQuery, ForceLeaderTest, MetricTriggerTest, 
TestReloadDeadlock, TestDistributedStatsComponentCardinality, SmileWriterTest, 
OverseerModifyCollectionTest, TestPayloadScoreQParserPlugin, TestJoin, 
DistributedFacetPivotLargeTest, TestConfig, DateMathParserTest, 
TestPHPSerializedResponseWriter, LeaderFailoverAfterPartitionTest, 
MetricUtilsTest, TestNamedUpdateProcessors, DocValuesTest, TestRecovery, 
TestRandomDVFaceting, TestUpdate, StatsReloadRaceTest, TestFastOutputStream, 
RulesTest, TestNumericRangeQuery64, ExternalFileFieldSortTest, 
AnalysisAfterCoreReloadTest, SimpleCollectionCreateDeleteTest, 
UpdateParamsTest, HLLSerializationTest, TestLegacyTerms, 
TestSweetSpotSimilarityFactory, TestWordDelimiterFilterFactory, 
TestSubQueryTransformerDistrib, DistributedFacetPivotSmallTest, BJQParserTest, 
TestSchemaNameResource, TestSchemalessBufferedUpdates, 
HdfsTlogReplayBufferedWhileIndexingTest, TestSuggestSpellingConverter, 
JsonLoaderTest, PKIAuthenticationIntegrationTest, TestJsonRequest, 
TestStressCloudBlindAtomicUpdates, BitVectorTest, TestCloudPseudoReturnFields, 
TestImpersonationWithHadoopAuth, TestPhraseSuggestions, CurrencyFieldTypeTest, 
RestartWhileUpdatingTest, DeleteReplicaTest, CdcrVersionReplicationTest, 
TestDistribIDF, TestCrossCoreJoin, TestCodecSupport, TestSimpleTextCodec, 
PeerSyncTest, TestUtils, TestFieldSortValues, 
OutOfBoxZkACLAndCredentialsProvidersTest, DistributedMLTComponentTest, 
DistributedFacetSimpleRefinementLongTailTest, AssignBackwardCompatibilityTest, 
TestClusterProperties, BlockCacheTest, TestSystemCollAutoCreate, 
TestLegacyFieldCache, BasicDistributedZkTest, SpellCheckComponentTest, 
FileUtilsTest, TestMinMaxOnMultiValuedField, TestMergePolicyConfig, 
RemoteQueryErrorTest, CursorPagingTest, BasicZkTest, TestLuceneIndexBackCompat, 
TestQueryUtils, SolrShardReporterTest, TestSolrJ, LargeFieldTest, 
TestOnReconnectListenerSupport, TestConfigSetsAPI, SpellCheckCollatorTest, 
TestSmileRequest, TestCSVLoader, DocExpirationUpdateProcessorFactoryTest, 
SolrPluginUtilsTest, CollectionStateFormat2Test, JvmMetricsTest, 
BadCopyFieldTest, HdfsDirectoryTest, URLClassifyProcessorTest, TestCoreBackup, 
MultiTermTest, ActionThrottleTest, TestChildDocTransformer, 
SaslZkACLProviderTest, TestDynamicFieldCollectionResource, 
TestManagedSchemaThreadSafety, TestHdfsUpdateLog, 
AtomicUpdateProcessorFactoryTest, DistributedQueueTest, 
DistributedDebugComponentTest, SyncSliceTest, TestCloudInspectUtil, 
UninvertDocValuesMergePolicyTest, TestLocalFSCloudBackupRestore, 
TestRebalanceLeaders, SolrJmxReporterTest, EnumFieldTest, TestPivotHelperCode, 
QueryResultKeyTest, TestCryptoKeys, CacheHeaderTest, TestTlogReplica, 
MultiThreadedOCPTest, ReplaceNodeTest, TestAuthenticationFramework, 
TestCloudDeleteByQuery, TestCloudJSONFacetJoinDomain, 
TestCollectionsAPIViaSolrCloudCluster, TestExclusionRuleCollectionAccess, 
TestLockTree, TestMiniSolrCloudClusterSSL, TestPullReplica, 
TestReplicaProperties, TestRequestForwarding, TestRequestStatusCollectionAPI, 
TestSolrCloudWithSecureImpersonation]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=B79C532C180EBE29 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=da 
-Dtests.timezone=America/Argentina/Buenos_Aires -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | TestSolrCloudWithSecureImpersonation (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE 
scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]    >    1) Thread[id=18069, 
name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >    2) Thread[id=18070, 
name=jetty-launcher-3587-thread-1-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   [junit4]    >    3) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >    4) Thread[id=18068, 
name=jetty-launcher-3587-thread-2-EventThread, state=WAITING, 
group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([B79C532C180EBE29]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=18069, 
name=jetty-launcher-3587-thread-1-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >    2) Thread[id=18067, 
name=jetty-launcher-3587-thread-2-SendThread(127.0.0.1:35233), 
state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([B79C532C180EBE29]:0)
   [junit4] Completed [557/765 (2!)] on J0 in 54.40s, 12 tests, 2 errors <<< 
FAILURES!

[...truncated 48804 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to