Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/800/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:34640: Could not load collection from 
ZK:nodes_used_collection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:34640: Could not load collection from 
ZK:nodes_used_collection
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:419)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


REGRESSION:  
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live 
nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       
"parent":null,       "range":null,       "state":"active",       
"replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr";,        
   "node_name":"node1",           "core":"core1",           "roles":"",         
  "state":"down"}}}},   "router":{"name":"implicit"}}, 
test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active 
clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr";,
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
        at 
__randomizedtesting.SeedInfo.seed([E8E2E78090B1D089:80FCE46C72218AC7]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:601)
        at 
org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1261)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1608, name=collection3, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=1608, name=collection3, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:46210: Could not find collection : 
awholynewstresscollection_collection3_0
        at __randomizedtesting.SeedInfo.seed([E8E2E78090B1D089]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10107 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/init-core-data-001
   [junit4]   2> 9040 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 9041 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 11512 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your 
platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 15054 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 16052 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via 
org.mortbay.log.Slf4jLog
   [junit4]   2> 16064 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 16338 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 16535 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_48593_hdfs____77huid/webapp
   [junit4]   2> 17223 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 18847 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:48593
   [junit4]   2> 20435 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 20444 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 20459 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_42589_datanode____acrfz3/webapp
   [junit4]   2> 20582 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 21226 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42589
   [junit4]   2> 21535 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 21548 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 21664 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_37307_datanode____.rij43n/webapp
   [junit4]   2> 21829 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 22559 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37307
   [junit4]   2> 23827 INFO  (IPC Server handler 6 on 56743) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-d94c410e-310b-48cd-b44b-236be7b9c9a8 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=801e754c-fc66-4023-8967-135d58016128, infoPort=37307, 
ipcPort=56127, storageInfo=lv=-56;cid=testClusterID;nsid=1105558588;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 3 msecs
   [junit4]   2> 23827 INFO  (IPC Server handler 5 on 56743) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-dfc44490-3816-4b2f-9807-d9f5dc1257ec node DatanodeRegistration(127.0.0.1, 
datanodeUuid=ff4a00be-457e-407b-be76-a8f0cc344006, infoPort=42589, 
ipcPort=55616, storageInfo=lv=-56;cid=testClusterID;nsid=1105558588;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 6 msecs
   [junit4]   2> 23829 INFO  (IPC Server handler 6 on 56743) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-adc99b72-f4b7-4c2c-a252-dfb19732bedf node DatanodeRegistration(127.0.0.1, 
datanodeUuid=801e754c-fc66-4023-8967-135d58016128, infoPort=37307, 
ipcPort=56127, storageInfo=lv=-56;cid=testClusterID;nsid=1105558588;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 23836 INFO  (IPC Server handler 5 on 56743) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-736b2d94-1bec-49dc-a75f-b1461888f038 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=ff4a00be-457e-407b-be76-a8f0cc344006, infoPort=42589, 
ipcPort=55616, storageInfo=lv=-56;cid=testClusterID;nsid=1105558588;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 24790 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 24793 INFO  (Thread-122) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 24794 INFO  (Thread-122) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 24892 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:33077
   [junit4]   2> 24927 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 24992 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 25065 INFO  (zkCallback-3-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@11b32fa0 
name:ZooKeeperConnection Watcher:127.0.0.1:33077 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25065 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 25066 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 25068 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 25135 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 25137 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x14ff054a3400000, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 25145 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 25164 INFO  (zkCallback-4-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@772eb878 
name:ZooKeeperConnection Watcher:127.0.0.1:33077/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25164 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 25165 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 25177 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 25185 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 25190 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 25193 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 25198 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 25199 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 25207 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 25207 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 25221 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 25221 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 25230 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 25231 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 25235 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 25236 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 25255 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 25255 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 25262 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 25263 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 25268 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 25269 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 25273 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 25273 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 25283 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 25284 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 25288 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 25289 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 25306 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 25332 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 25368 INFO  (zkCallback-5-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@39712ed8 
name:ZooKeeperConnection Watcher:127.0.0.1:33077 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25368 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 25369 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 25369 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 25382 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 25408 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 25428 INFO  (zkCallback-6-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c383d01 
name:ZooKeeperConnection Watcher:127.0.0.1:33077/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 25429 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 25429 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 25430 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 25430 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 25447 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 25448 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 25451 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf2/enumsConfig.xml
   [junit4]   2> 25452 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 25456 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 25456 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 25460 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 25460 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 25465 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 25466 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 25469 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 25470 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 25473 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 25473 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 25476 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 25477 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 25482 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 25483 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 25489 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 25489 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 25494 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 25495 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 26052 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1
   [junit4]   2> 26236 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 26483 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@3a025e52{/,null,AVAILABLE}
   [junit4]   2> 26497 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7d06b36c{HTTP/1.1}{127.0.0.1:56290}
   [junit4]   2> 26498 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.Server Started @30111ms
   [junit4]   2> 26498 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:56743/hdfs__localhost_56743__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001_tempDir-002_control_data,
 hostContext=/, hostPort=56290, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores}
   [junit4]   2> 26515 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 26517 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/'
   [junit4]   2> 26537 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 26544 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 26556 INFO  (zkCallback-7-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1110f39b 
name:ZooKeeperConnection Watcher:127.0.0.1:33077/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 26556 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 26557 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 26565 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 26568 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/solr.xml
   [junit4]   2> 26603 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores
   [junit4]   2> 26604 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1494999927
   [junit4]   2> 26604 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/]
   [junit4]   2> 26604 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/lib
   [junit4]   2> 26605 WARN  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/lib).
   [junit4]   2> 26677 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 26705 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 26706 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 26706 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 26718 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33077/solr
   [junit4]   2> 26745 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 26746 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 26760 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 26776 INFO  (zkCallback-9-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@13281c86 
name:ZooKeeperConnection Watcher:127.0.0.1:33077 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 26778 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 26778 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 26804 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 26828 INFO  
(zkCallback-10-thread-1-processing-n:127.0.0.1:56290_) [n:127.0.0.1:56290_    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@52c6fc2f 
name:ZooKeeperConnection Watcher:127.0.0.1:33077/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 26829 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 26839 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 26852 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 26859 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 26864 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 26868 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 26895 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 26902 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 26911 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 26918 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 26920 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:56290_
   [junit4]   2> 26925 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:56290_
   [junit4]   2> 26949 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 26952 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 26960 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 26962 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.LeaderElector Joined leadership election with 
path: /overseer_elect/election/94558363504869382-127.0.0.1:56290_-n_0000000000
   [junit4]   2> 26968 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:56290_
   [junit4]   2> 26969 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 26973 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer Overseer 
(id=94558363504869382-127.0.0.1:56290_-n_0000000000) starting
   [junit4]   2> 26986 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 27045 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 27049 INFO  
(OverseerCollectionConfigSetProcessor-94558363504869382-127.0.0.1:56290_-n_0000000000)
 [n:127.0.0.1:56290_    ] o.a.s.c.OverseerTaskProcessor Process current queue 
of overseer operations
   [junit4]   2> 27049 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 27100 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 27368 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 27369 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 27373 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.CoresLocator Looking for core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores
   [junit4]   2> 27378 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 27378 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.CoresLocator Found core collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1/
   [junit4]   2> 27378 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 27392 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 27392 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) 
[n:127.0.0.1:56290_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() 
done
   [junit4]   2> 27400 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
publishing state=down
   [junit4]   2> 27401 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 27410 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56290";,
   [junit4]   2>   "node_name":"127.0.0.1:56290_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 27417 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
look for our core node name
   [junit4]   2> 27429 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56290";,
   [junit4]   2>   "node_name":"127.0.0.1:56290_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 27433 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.o.ClusterStateMutator building a new cName: 
control_collection
   [junit4]   2> 27437 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 27459 INFO  
(zkCallback-10-thread-1-processing-n:127.0.0.1:56290_) [n:127.0.0.1:56290_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 28418 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
waiting to find shard id in clusterstate for collection1
   [junit4]   2> 28419 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Check for collection zkNode:control_collection
   [junit4]   2> 28420 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.ZkController 
Collection zkNode exists
   [junit4]   2> 28420 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 28421 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 28422 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1/'
   [junit4]   2> 28446 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.Config loaded 
config solrconfig.xml with version 0 
   [junit4]   2> 28485 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
current version of requestparams : -1
   [junit4]   2> 28492 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 28517 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.Config Loaded 
SolrConfig: solrconfig.xml
   [junit4]   2> 28525 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 28564 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 28890 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 28907 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
default search field in schema is text
   [junit4]   2> 28921 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
unique key field: id
   [junit4]   2> 28980 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 28998 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 29002 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 29009 WARN  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 29010 WARN  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 29010 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 29011 WARN  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 29011 WARN  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 29025 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 29026 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 29026 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 29048 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:56743/solr_hdfs_home
   [junit4]   2> 29048 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 29049 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 29050 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@69b6d28
   [junit4]   2> 29070 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 29200 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data for 
locality metrics.
   [junit4]   2> 29200 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 29207 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 29275 WARN  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:56743/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 29275 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 29312 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data/index 
for locality metrics.
   [junit4]   2> 29312 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 29314 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.2255859375, 
noCFSRatio=0.8435516103544985]
   [junit4]   2> 30000 INFO  (IPC Server handler 4 on 56743) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52868 is 
added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-adc99b72-f4b7-4c2c-a252-dfb19732bedf:NORMAL:127.0.0.1:52868|RBW],
 
ReplicaUnderConstruction[[DISK]DS-736b2d94-1bec-49dc-a75f-b1461888f038:NORMAL:127.0.0.1:38731|RBW]]}
 size 71
   [junit4]   2> 30030 INFO  (IPC Server handler 3 on 56743) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38731 is 
added to blk_1073741825_1001 size 71
   [junit4]   2> 30437 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b8c0d0e1 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e6cb563; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 30438 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 30462 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
Looking for old index directories to cleanup for core collection1 in 
hdfs://localhost:56743/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 30467 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"nodistrib"
   [junit4]   2> 30516 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 30517 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 30517 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 30517 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 30517 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-explicit"
   [junit4]   2> 30518 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 30518 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 30548 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating 
implicit default
   [junit4]   2> 30567 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 30610 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 30612 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 30613 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 30703 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 30704 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 30725 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 30726 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 30844 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 30845 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 30875 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@1e087f08
   [junit4]   2> 31106 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b8c0d0e1 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e6cb563; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 31106 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 31107 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening Searcher@78457726[collection1] main
   [junit4]   2> 31107 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 31109 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 31109 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the 
RestManager with znodeBase: /configs/conf1
   [junit4]   2> 31125 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 31125 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 31126 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 31127 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage No data found for znode 
/configs/conf1/_rest_managed.json
   [junit4]   2> 31127 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 31127 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 31127 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 31134 INFO  
(searcherExecutor-29-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@78457726[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 31165 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 31165 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version 
buckets from index
   [junit4]   2> 31165 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket 
highest value from index
   [junit4]   2> 31165 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1512933822681841664
   [junit4]   2> 31165 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 
1512933822681841664
   [junit4]   2> 31167 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 31175 INFO  
(coreLoadExecutor-28-thread-1-processing-n:127.0.0.1:56290_) 
[n:127.0.0.1:56290_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 31186 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
Register replica - core:collection1 address:http://127.0.0.1:56290 
collection:control_collection shard:shard1
   [junit4]   2> 31204 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 31221 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector 
Joined leadership election with path: 
/collections/control_collection/leader_elect/shard1/election/94558363504869382-core_node1-n_0000000000
   [junit4]   2> 31224 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 31228 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 31228 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 31228 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 31235 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:56290/collection1/
   [junit4]   2> 31235 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 31235 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:56290/collection1/ has no replicas
   [junit4]   2> 31235 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:56290/collection1/ shard1
   [junit4]   2> 31236 INFO  
(zkCallback-10-thread-1-processing-n:127.0.0.1:56290_) [n:127.0.0.1:56290_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 31240 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 31267 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 31295 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:56290";,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 31402 INFO  
(zkCallback-10-thread-1-processing-n:127.0.0.1:56290_) [n:127.0.0.1:56290_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 31447 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
We are http://127.0.0.1:56290/collection1/ and leader is 
http://127.0.0.1:56290/collection1/
   [junit4]   2> 31447 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56290
   [junit4]   2> 31447 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 31447 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
publishing state=active
   [junit4]   2> 31448 INFO  
(coreZkRegister-22-thread-1-processing-n:127.0.0.1:56290_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56290_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
numShards not found on descriptor - reading it from system property
   [junit4]   2> 31456 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message 
= {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56290";,
   [junit4]   2>   "node_name":"127.0.0.1:56290_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 31458 INFO  
(OverseerStateUpdate-94558363504869382-127.0.0.1:56290_-n_0000000000) 
[n:127.0.0.1:56290_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 
message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56290";,
   [junit4]   2>   "node_name":"127.0.0.1:56290_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 31481 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 31482 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 31534 INFO  (zkCallback-12-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3bd05080 
name:ZooKeeperConnection Watcher:127.0.0.1:33077/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 31534 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 31535 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 31535 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 31541 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection 
loss:false
   [junit4]   2> 31564 INFO  (zkCallback-12-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 31564 INFO  
(zkCallback-10-thread-1-processing-n:127.0.0.1:56290_) [n:127.0.0.1:56290_    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
   [junit4]   2> 32344 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/shard-1-001/cores/collection1
   [junit4]   2> 32346 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/shard-1-001
   [junit4]   2> 32347 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 32371 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@417386f6{/,null,AVAILABLE}
   [junit4]   2> 32372 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@7f3ee0c4{HTTP/1.1}{127.0.0.1:46210}
   [junit4]   2> 32379 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.e.j.s.Server Started @35992ms
   [junit4]   2> 32379 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:56743/hdfs__localhost_56743__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/, hostPort=46210, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/shard-1-001/cores}
   [junit4]   2> 32380 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 32380 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E8E2E78090B1D089-001/shard-1-001/'
   [junit4]   2> 32419 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E8E2E78090B1D089]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
  

[...truncated too long message...]

ption in thread: Thread[id=19417, name=collection4, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[http://127.0.0.1:54233, http://127.0.0.1:50803, 
http://127.0.0.1:43183, http://127.0.0.1:34640, http://127.0.0.1:36410]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([E8E2E78090B1D089]:0)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
No live SolrServers available to handle this request:[http://127.0.0.1:54233, 
http://127.0.0.1:50803, http://127.0.0.1:43183, http://127.0.0.1:34640, 
http://127.0.0.1:36410]
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
Timeout occured while waiting response from server at: http://127.0.0.1:36410
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:587)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        ... 5 more
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    >        at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    >        at 
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:170)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    >        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    >        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    >        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    >        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
   [junit4]    >        ... 9 more
   [junit4]   2> 2909600 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[E8E2E78090B1D089]-worker) 
[n:127.0.0.1:54233_ c:awholynewstresscollection_collection5_0 s:shard3 
r:core_node5 x:awholynewstresscollection_collection5_0_shard3_replica2] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E8E2E78090B1D089-001
   [junit4]   2> Sep 21, 2015 11:23:27 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): 
{other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=FSTOrd50, 
_version_=BlockTreeOrds(blocksize=128), 
multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 a_t=BlockTreeOrds(blocksize=128), intDefault=BlockTreeOrds(blocksize=128), 
a_i1=BlockTreeOrds(blocksize=128), id=FSTOrd50, 
range_facet_i_dv=BlockTreeOrds(blocksize=128), text=Lucene50(blocksize=128), 
range_facet_l=BlockTreeOrds(blocksize=128), 
timestamp=BlockTreeOrds(blocksize=128)}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), 
range_facet_i_dv=DocValuesFormat(name=Memory), 
timestamp=DocValuesFormat(name=Memory)}, sim=ClassicSimilarity, locale=lt_LT, 
timezone=America/Montserrat
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=108894336,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [TestQueryTypes, 
TestStressUserVersions, AnalysisErrorHandlingTest, ChangedSchemaMergeTest, 
PreAnalyzedFieldTest, MergeStrategyTest, TriLevelCompositeIdRoutingTest, 
TestMacros, FastVectorHighlighterTest, SolrIndexSplitterTest, TestRestoreCore, 
TestSchemaVersionResource, ClusterStateUpdateTest, TestCodecSupport, 
MinimalSchemaTest, TestFieldTypeResource, StressHdfsTest, 
TestMiniSolrCloudCluster, TestBinaryResponseWriter, ChaosMonkeySafeLeaderTest, 
TestQueryUtils, TestConfigOverlay, HdfsRecoverLeaseTest, TestSQLHandler, 
TestLFUCache, TestDFRSimilarityFactory, 
IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestHashPartitioner, 
HdfsNNFailoverTest, ShardRoutingTest, MultiTermTest, TestDynamicLoading, 
CleanupOldIndexTest, DocumentBuilderTest, UniqFieldsUpdateProcessorFactoryTest, 
TestSurroundQueryParser, TestSolrQueryParserResource, ShardSplitTest, 
TestConfigSets, DistributedFacetPivotLongTailTest, TestSchemaManager, 
TestDistributedGrouping, ZkControllerTest, 
VMParamsZkACLAndCredentialsProvidersTest, TestAuthenticationFramework, 
TestSolrDeletionPolicy2, ChaosMonkeyNothingIsSafeTest, SuggesterFSTTest, 
TermVectorComponentTest, TestSuggestSpellingConverter, 
TestWordDelimiterFilterFactory, HdfsLockFactoryTest, DateRangeFieldTest, 
SolrCmdDistributorTest, DistanceUnitsTest, CustomCollectionTest, 
TestObjectReleaseTracker, HdfsRecoveryZkTest, TestShortCircuitedRequests, 
ZkCLITest, TestUtils, TestBM25SimilarityFactory, TestStressVersions, 
PreAnalyzedUpdateProcessorTest, DistributedQueueTest, TestJmxMonitoredMap, 
TestJettySolrRunner, DocValuesTest, SpatialFilterTest, ShardRoutingCustomTest, 
TestOverriddenPrefixQueryForCustomFieldType, TestManagedSchema, 
SoftAutoCommitTest, TestCloudPivotFacet, TestCopyFieldCollectionResource, 
TestDistribDocBasedVersion, SolrIndexConfigTest, ZkSolrClientTest, 
TestCoreContainer, SpellPossibilityIteratorTest, DistanceFunctionTest, 
DistribDocExpirationUpdateProcessorTest, WordBreakSolrSpellCheckerTest, 
URLClassifyProcessorTest, RulesTest, AddSchemaFieldsUpdateProcessorFactoryTest, 
TestScoreJoinQPScore, TestCustomSort, TestCryptoKeys, 
DistributedFacetPivotWhiteBoxTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [232/546] on J1 in 794.95s, 1 test, 1 error <<< FAILURES!

[...truncated 1012 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987:
 There were test failures: 546 suites, 2145 tests, 2 errors, 1 failure, 29 
ignored (17 assumptions)

Total time: 189 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to