Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/641/

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create 
core [halfcollection_shard1_replica1] Caused by: Could not get shard id for 
core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error 
CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core 
[halfcollection_shard1_replica1] Caused by: Could not get shard id for core: 
halfcollection_shard1_replica1
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12117 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/init-core-data-001
   [junit4]   2> 1189713 T7447 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (true)
   [junit4]   2> 1189714 T7447 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /pt/f
   [junit4]   2> 1189719 T7447 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 1189720 T7447 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1189721 T7448 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1189822 T7447 oasc.ZkTestServer.run start zk server on 
port:47908
   [junit4]   2> 1189823 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1189824 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1189828 T7454 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@206d48d7 
name:ZooKeeperConnection Watcher:127.0.0.1:47908 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1189828 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1189829 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1189829 T7447 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1189832 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1189833 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1189834 T7456 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@234d95c9 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1189835 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1189835 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1189835 T7447 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 1189837 T7447 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 1189839 T7447 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 1189840 T7447 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 1189842 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1189842 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 1189845 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1189845 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 1189847 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1189848 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1189850 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1189850 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 1189852 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1189852 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 1189854 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1189854 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 1189856 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1189857 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 1189858 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1189859 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 1189860 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1189861 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1189863 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1189863 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 1189865 T7447 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1189865 T7447 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 1189867 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1189868 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1189869 T7458 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5c02faa0 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1189869 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1189869 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 1191033 T7447 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1191047 T7447 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1191050 T7447 oejs.AbstractConnector.doStart Started 
[email protected]:47912
   [junit4]   2> 1191052 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1191052 T7447 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1191053 T7447 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002
   [junit4]   2> 1191053 T7447 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/'
   [junit4]   2> 1191082 T7447 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solr.xml
   [junit4]   2> 1191123 T7447 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002
   [junit4]   2> 1191123 T7447 oasc.CoreContainer.<init> New CoreContainer 
1145458024
   [junit4]   2> 1191123 T7447 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/]
   [junit4]   2> 1191124 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1191125 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1191125 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1191125 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1191125 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1191125 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1191126 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1191126 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1191126 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1191128 T7447 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1191130 T7447 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1191130 T7447 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1191130 T7447 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1191131 T7447 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:47908/solr
   [junit4]   2> 1191131 T7447 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1191131 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1191132 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1191134 T7469 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@25084bb name:ZooKeeperConnection 
Watcher:127.0.0.1:47908 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1191135 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1191135 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1191137 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1191138 T7471 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@348490d5 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1191138 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1191139 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1191141 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1191143 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1191145 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1191146 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1191148 T7447 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1191149 T7447 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47912_pt%2Ff
   [junit4]   2> 1191150 T7447 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47912_pt%2Ff
   [junit4]   2> 1191152 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1191153 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1191154 T7447 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1191155 T7447 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:47912_pt%2Ff
   [junit4]   2> 1191156 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1191157 T7447 oasc.Overseer.start Overseer 
(id=92531166186831876-127.0.0.1:47912_pt%2Ff-n_0000000000) starting
   [junit4]   2> 1191159 T7447 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1191164 T7447 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1191165 T7473 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1191166 T7447 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1191167 T7447 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1191168 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1191170 T7472 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1191172 T7447 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002
   [junit4]   2> 1192450 T7447 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/conf/
   [junit4]   2> 1192450 T7447 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 1192451 T7447 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1192451 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1192455 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1192456 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1192457 T7477 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6e19cdf7 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1192457 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1192457 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1192458 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1192460 T7447 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 1192460 T7447 oasc.AbstractFullDistribZkTestBase.createJettys 
Creating collection1 with stateFormat=2
   [junit4]   2> 1192461 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1192461 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1192462 T7479 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@56104331 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1192462 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1192462 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1192464 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1192466 T7472 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
collection1
   [junit4]   2> 1192466 T7472 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 1192466 T7472 
oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1192468 T7472 oasc.Overseer$ClusterStateUpdater.updateZkStates 
going to create_collection /collections/collection1/state.json
   [junit4]   2> 1192469 T7480 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1192469 T7481 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1193404 T7447 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 1193404 T7447 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1193408 T7447 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1193410 T7447 oejs.AbstractConnector.doStart Started 
[email protected]:47922
   [junit4]   2> 1193412 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1193412 T7447 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1193413 T7447 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003
   [junit4]   2> 1193413 T7447 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/'
   [junit4]   2> 1193442 T7447 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solr.xml
   [junit4]   2> 1193484 T7447 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003
   [junit4]   2> 1193484 T7447 oasc.CoreContainer.<init> New CoreContainer 
810882588
   [junit4]   2> 1193484 T7447 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/]
   [junit4]   2> 1193485 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1193485 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1193486 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1193486 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1193486 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1193486 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1193486 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1193487 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1193487 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1193489 T7447 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1193491 T7447 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1193491 T7447 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1193491 T7447 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1193491 T7447 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:47908/solr
   [junit4]   2> 1193492 T7447 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1193492 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1193492 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1193494 T7492 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@231f37d4 
name:ZooKeeperConnection Watcher:127.0.0.1:47908 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1193495 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1193495 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1193496 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1193497 T7494 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a833c3a 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1193497 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1193502 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1194506 T7447 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47922_pt%2Ff
   [junit4]   2> 1194507 T7447 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47922_pt%2Ff
   [junit4]   2> 1194510 T7447 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1194514 T7447 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003
   [junit4]   2> 1194543 T7447 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/conf/
   [junit4]   2> 1195690 T7447 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 1195691 T7447 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1195691 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1196633 T7447 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 1196634 T7447 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1196638 T7447 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1196640 T7447 oejs.AbstractConnector.doStart Started 
[email protected]:47931
   [junit4]   2> 1196642 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1196642 T7447 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1196642 T7447 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004
   [junit4]   2> 1196643 T7447 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004/'
   [junit4]   2> 1196672 T7447 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004/solr.xml
   [junit4]   2> 1196714 T7447 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004
   [junit4]   2> 1196714 T7447 oasc.CoreContainer.<init> New CoreContainer 
1851904556
   [junit4]   2> 1196715 T7447 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004/]
   [junit4]   2> 1196716 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1196716 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1196716 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1196716 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1196716 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1196717 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1196717 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1196717 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1196717 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1196719 T7447 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1196721 T7447 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1196721 T7447 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1196722 T7447 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1196722 T7447 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:47908/solr
   [junit4]   2> 1196722 T7447 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1196722 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1196723 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1196724 T7507 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@202505b2 
name:ZooKeeperConnection Watcher:127.0.0.1:47908 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1196725 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1196726 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1196727 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1196728 T7509 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f881d90 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1196728 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1196732 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1197736 T7447 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47931_pt%2Ff
   [junit4]   2> 1197737 T7447 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47931_pt%2Ff
   [junit4]   2> 1197740 T7447 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1197746 T7447 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004
   [junit4]   2> 1199009 T7447 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-004/conf/
   [junit4]   2> 1199012 T7447 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 1199013 T7447 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1199013 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1199939 T7447 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 1199940 T7447 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1199944 T7447 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1199945 T7447 oejs.AbstractConnector.doStart Started 
[email protected]:47935
   [junit4]   2> 1199948 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1199948 T7447 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1199948 T7447 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005
   [junit4]   2> 1199948 T7447 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/'
   [junit4]   2> 1199977 T7447 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solr.xml
   [junit4]   2> 1200019 T7447 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005
   [junit4]   2> 1200019 T7447 oasc.CoreContainer.<init> New CoreContainer 
906566464
   [junit4]   2> 1200019 T7447 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/]
   [junit4]   2> 1200020 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1200021 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1200021 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1200021 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1200021 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1200021 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1200022 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1200022 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1200022 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1200024 T7447 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1200026 T7447 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1200026 T7447 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1200026 T7447 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1200026 T7447 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:47908/solr
   [junit4]   2> 1200027 T7447 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1200027 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1200028 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1200029 T7522 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@472469ee 
name:ZooKeeperConnection Watcher:127.0.0.1:47908 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1200030 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1200030 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1200032 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1200033 T7524 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7f380bdb 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1200033 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1200037 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1201041 T7447 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47935_pt%2Ff
   [junit4]   2> 1201042 T7447 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47935_pt%2Ff
   [junit4]   2> 1201045 T7447 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1201050 T7447 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005
   [junit4]   2> 1201225 T7447 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/conf/
   [junit4]   2> 1202513 T7447 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 1202514 T7447 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1202514 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1203458 T7447 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 1203458 T7447 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1203462 T7447 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1203464 T7447 oejs.AbstractConnector.doStart Started 
[email protected]:47941
   [junit4]   2> 1203466 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1203467 T7447 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1203467 T7447 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006
   [junit4]   2> 1203467 T7447 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/'
   [junit4]   2> 1203496 T7447 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solr.xml
   [junit4]   2> 1203538 T7447 oasc.CorePropertiesLocator.<init> Config-defined 
core root directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006
   [junit4]   2> 1203539 T7447 oasc.CoreContainer.<init> New CoreContainer 
1304405461
   [junit4]   2> 1203539 T7447 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/]
   [junit4]   2> 1203540 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1203540 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1203540 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1203541 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1203541 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1203541 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1203541 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1203541 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1203542 T7447 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1203544 T7447 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1203545 T7447 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1203546 T7447 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1203546 T7447 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1203546 T7447 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:47908/solr
   [junit4]   2> 1203546 T7447 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1203547 T7447 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 1203547 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1203549 T7537 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@760e7c17 
name:ZooKeeperConnection Watcher:127.0.0.1:47908 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1203549 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1203550 T7447 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 1203551 T7447 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1203552 T7539 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6299b97b 
name:ZooKeeperConnection Watcher:127.0.0.1:47908/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1203552 T7447 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1203556 T7447 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1204562 T7447 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47941_pt%2Ff
   [junit4]   2> 1204563 T7447 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:47941_pt%2Ff
   [junit4]   2> 1204566 T7447 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1204571 T7447 oasc.CorePropertiesLocator.discover Looking for 
core definitions underneath 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006
   [junit4]   2> 1204575 T7447 oasc.CorePropertiesLocator.discoverUnder Found 
core conf in 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/conf/
   [junit4]   2> 1206049 T7447 oasc.CorePropertiesLocator.discover Found 1 core 
definitions
   [junit4]   2> 1206050 T7447 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3
   [junit4]   2> 1206050 T7447 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1206184 T7484 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
version=2&replicationFactor=2&name=solrj_collection&router.field=myOwnField&action=CREATE&wt=javabin&collection.configName=conf1&numShards=2
   [junit4]   2> 1206186 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 1206186 T7473 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 1206187 T7543 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 1206188 T7543 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1206189 T7543 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 1206191 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1206193 T7472 
oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: 
solrj_collection
   [junit4]   2> 1206193 T7472 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
solrj_collection with shards [shard1, shard2]
   [junit4]   2> 1206193 T7472 
oasc.Overseer$ClusterStateUpdater.createCollection state version 
solrj_collection 1
   [junit4]   2> 1206195 T7480 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206195 T7510 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206195 T7540 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206195 T7525 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206195 T7481 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206195 T7495 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206291 T7543 
oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new 
collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 1206292 T7543 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica1 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:47941_pt%2Ff
   [junit4]   2> 1206293 T7543 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard1_replica2 as part of slice shard1 of collection 
solrj_collection on 127.0.0.1:47922_pt%2Ff
   [junit4]   2> 1206293 T7543 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica1 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:47935_pt%2Ff
   [junit4]   2> 1206296 T7543 
oasc.OverseerCollectionProcessor.createCollection Creating shard 
solrj_collection_shard2_replica2 as part of slice shard2 of collection 
solrj_collection on 127.0.0.1:47912_pt%2Ff
   [junit4]   2> 1206416 T7486 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&shard=shard1&version=2&name=solrj_collection_shard1_replica2&collection=solrj_collection&action=CREATE&wt=javabin&collection.configName=conf1&numShards=2
   [junit4]   2> 1206420 T7529 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&shard=shard1&version=2&name=solrj_collection_shard1_replica1&collection=solrj_collection&action=CREATE&wt=javabin&collection.configName=conf1&numShards=2
   [junit4]   2> 1206420 T7517 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&shard=shard2&version=2&name=solrj_collection_shard2_replica1&collection=solrj_collection&action=CREATE&wt=javabin&collection.configName=conf1&numShards=2
   [junit4]   2> 1206420 T7486 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 1206421 T7486 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1206421 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1206422 T7529 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 1206423 T7529 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1206423 T7517 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 1206424 T7472 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "base_url":"https://127.0.0.1:47922/pt/f";,
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:47922_pt%2Ff",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 1206424 T7517 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1206426 T7472 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "base_url":"https://127.0.0.1:47941/pt/f";,
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:47941_pt%2Ff",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 1206427 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1206427 T7462 oasha.CoreAdminHandler.handleCreateAction core 
create command 
qt=/admin/cores&shard=shard2&version=2&name=solrj_collection_shard2_replica2&collection=solrj_collection&action=CREATE&wt=javabin&collection.configName=conf1&numShards=2
   [junit4]   2> 1206428 T7472 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "base_url":"https://127.0.0.1:47935/pt/f";,
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:47935_pt%2Ff",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 1206430 T7462 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 1206430 T7480 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1206430 T7462 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1206431 T7472 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "base_url":"https://127.0.0.1:47912/pt/f";,
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:47912_pt%2Ff",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "operation":"state"}
   [junit4]   2> 1206533 T7540 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206533 T7525 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206533 T7510 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206533 T7495 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206533 T7480 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1206533 T7481 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1207421 T7486 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1207422 T7486 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1207423 T7486 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1207423 T7486 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1207423 T7529 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1207424 T7486 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1207424 T7529 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1207424 T7486 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/'
   [junit4]   2> 1207425 T7529 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1207425 T7529 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1207426 T7529 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1207426 T7529 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/'
   [junit4]   2> 1207426 T7517 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1207427 T7517 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1207427 T7517 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1207428 T7517 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1207428 T7517 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1207429 T7517 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/'
   [junit4]   2> 1207431 T7462 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1207432 T7462 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:solrj_collection
   [junit4]   2> 1207432 T7462 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1207433 T7462 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/solrj_collection
   [junit4]   2> 1207433 T7462 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1207433 T7462 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/'
   [junit4]   2> 1207604 T7517 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 1207605 T7486 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 1207605 T7462 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 1207605 T7529 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: 6.0.0
   [junit4]   2> 1207661 T7517 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1207661 T7486 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1207662 T7517 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1207662 T7529 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1207663 T7486 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1207663 T7462 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1207663 T7529 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1207664 T7462 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1207673 T7517 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1207674 T7486 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1207675 T7462 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1207674 T7529 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1208152 T7517 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1208153 T7462 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1208154 T7486 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1208154 T7529 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1208163 T7517 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1208164 T7529 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1208165 T7486 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1208166 T7462 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1208167 T7517 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1208167 T7529 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1208168 T7486 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1208169 T7462 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1208179 T7517 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208180 T7529 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208180 T7486 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208181 T7462 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208184 T7517 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208185 T7529 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208186 T7462 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208186 T7486 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1208189 T7517 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208190 T7529 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208190 T7517 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208191 T7462 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208193 T7486 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208193 T7529 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208194 T7529 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208194 T7486 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208193 T7517 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208195 T7486 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208194 T7529 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208194 T7462 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208196 T7462 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208195 T7486 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208195 T7517 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208196 T7462 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1208196 T7529 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208198 T7517 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208197 T7486 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208198 T7517 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208198 T7462 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1208198 T7529 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208199 T7462 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208199 T7517 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 1208199 T7486 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1208200 T7517 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1208200 T7462 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard2_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 1208200 T7529 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica1' using configuration from collection 
solrj_collection
   [junit4]   2> 1208201 T7462 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1208201 T7517 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica1] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/data/
   [junit4]   2> 1208201 T7486 oasc.CoreContainer.create Creating SolrCore 
'solrj_collection_shard1_replica2' using configuration from collection 
solrj_collection
   [junit4]   2> 1208203 T7517 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4a5a1d04
   [junit4]   2> 1208202 T7462 oasc.SolrCore.<init> 
[solrj_collection_shard2_replica2] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/data/
   [junit4]   2> 1208202 T7529 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1208204 T7462 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4a5a1d04
   [junit4]   2> 1208203 T7486 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1208204 T7529 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica1] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/data/
   [junit4]   2> 1208205 T7462 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/data
   [junit4]   2> 1208204 T7517 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/data
   [junit4]   2> 1208205 T7462 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 1208205 T7529 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4a5a1d04
   [junit4]   2> 1208205 T7486 oasc.SolrCore.<init> 
[solrj_collection_shard1_replica2] Opening new SolrCore at 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/,
 
dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/data/
   [junit4]   2> 1208206 T7462 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard2_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1208206 T7517 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 1208208 T7462 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-002/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 1208208 T7517 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard2_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1208207 T7529 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/data
   [junit4]   2> 1208207 T7486 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@4a5a1d04
   [junit4]   2> 1208209 T7529 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 1208209 T7517 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-005/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 1208210 T7486 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/data
   [junit4]   2> 1208208 T7462 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.47161713808175554]
   [junit4]   2> 1208211 T7486 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 1208210 T7517 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.47161713808175554]
   [junit4]   2> 1208210 T7529 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica1] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1208212 T7462 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-31a77bd5)),segFN=segments_1,generation=1}
   [junit4]   2> 1208212 T7486 oasc.SolrCore.initIndex WARN 
[solrj_collection_shard1_replica2] Solr index directory 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1208213 T7462 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1208213 T7529 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-006/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 1208212 T7517 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-28f2f0ed)),segFN=segments_1,generation=1}
   [junit4]   2> 1208214 T7529 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.47161713808175554]
   [junit4]   2> 1208213 T7486 oasc.CachingDirectoryFactory.get return new 
directory for 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001/tempDir-003/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 1208214 T7517 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1208215 T7486 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: 
minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.47161713808175554]
   [junit4]   2> 1208215 T7529 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-6950dfda)),segFN=segments_1,generation=1}
   [junit4]   2> 1208216 T7529 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1208216 T7486 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-305dff85)),segFN=segments_1,generation=1}
   [junit4]   2> 1208217 T7486 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1208218 T7462 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1208218 T7462 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1208219 T7462 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1208219 T7462 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1208219 T7462 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1208220 T7517 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1208220 T7462 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1208220 T7517 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1208221 T7462 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1208221 T7517 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1208221 T7462 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1208222 T7486 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1208221 T7529 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1208221 T7517 oasu

[...truncated too long message...]

che.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
   [junit4]    >        ... 6 moreThrowable #6: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=8316, name=Thread-5789, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[https://127.0.0.1:47941/pt/f, 
https://127.0.0.1:47935/pt/f, https://127.0.0.1:47931/pt/f, 
https://127.0.0.1:47922/pt/f, https://127.0.0.1:47912/pt/f]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([E3B382245212DDA]:0)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
No live SolrServers available to handle this 
request:[https://127.0.0.1:47941/pt/f, https://127.0.0.1:47935/pt/f, 
https://127.0.0.1:47931/pt/f, https://127.0.0.1:47922/pt/f, 
https://127.0.0.1:47912/pt/f]
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1632)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1653)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
fully create collection: awholynewstresscollection_collection3_1
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
   [junit4]    >        ... 6 moreThrowable #7: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=8314, name=Thread-5787, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available 
to handle this request:[https://127.0.0.1:47941/pt/f, 
https://127.0.0.1:47935/pt/f, https://127.0.0.1:47931/pt/f, 
https://127.0.0.1:47922/pt/f, https://127.0.0.1:47912/pt/f]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([E3B382245212DDA]:0)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
No live SolrServers available to handle this 
request:[https://127.0.0.1:47941/pt/f, https://127.0.0.1:47935/pt/f, 
https://127.0.0.1:47931/pt/f, https://127.0.0.1:47922/pt/f, 
https://127.0.0.1:47912/pt/f]
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1632)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1653)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not 
fully create collection: awholynewstresscollection_collection1_1
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
   [junit4]    >        ... 6 more
   [junit4]   2> 2108624 T7447 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-E3B382245212DDA-001
   [junit4]   2> 918917 T7446 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): 
{text=PostingsFormat(name=Asserting), _version_=OrdsLucene41(blocksize=128), 
a_i1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))),
 
timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))),
 intDefault=OrdsLucene41(blocksize=128), id=FSTOrd41, 
range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))),
 other_tl1=OrdsLucene41(blocksize=128), 
multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))),
 
a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128)))},
 docValues:{timestamp=DocValuesFormat(name=Asserting)}, 
sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_SA, 
timezone=Pacific/Rarotonga
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=135923776,total=409468928
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestPHPSerializedResponseWriter, InfoHandlerTest, TestDocSet, 
HdfsDirectoryTest, RollingRestartTest, IndexBasedSpellCheckerTest, 
TestChildDocTransformer, FieldAnalysisRequestHandlerTest, SuggesterTSTTest, 
AsyncMigrateRouteKeyTest, TestImplicitCoreProperties, 
DocExpirationUpdateProcessorFactoryTest, SolrIndexSplitterTest, 
TestCoreDiscovery, TestManagedResourceStorage, 
DistributedQueryComponentOptimizationTest, RequestHandlersTest, SliceStateTest, 
UUIDFieldTest, ZkCLITest, WordBreakSolrSpellCheckerTest, TestSort, 
TestFileDictionaryLookup, DocValuesMultiTest, LoggingHandlerTest, 
SolrInfoMBeanTest, StatelessScriptUpdateProcessorFactoryTest, 
TestNonDefinedSimilarityFactory, BadIndexSchemaTest, SolrPluginUtilsTest, 
FieldMutatingUpdateProcessorTest, DeleteInactiveReplicaTest, TestSearchPerf, 
CustomCollectionTest, SolrXmlInZkTest, CoreAdminHandlerTest, DOMUtilTest, 
FileBasedSpellCheckerTest, TimeZoneUtilsTest, ReplicationFactorTest, 
TestReRankQParserPlugin, TermVectorComponentDistributedTest, SearchHandlerTest, 
DistributedIntervalFacetingTest, TestFastLRUCache, 
UniqFieldsUpdateProcessorFactoryTest, HdfsRecoveryZkTest, TestCSVLoader, 
TestSchemaNameResource, TestFastWriter, TestInfoStreamLogging, 
CollectionsAPIDistributedZkTest]
   [junit4] Completed on J3 in 919.71s, 1 test, 1 error <<< FAILURES!

[...truncated 659 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:531:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1359:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:961:
 There were test failures: 432 suites, 1778 tests, 1 error, 54 ignored (10 
assumptions)

Total time: 176 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-trunk #636
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 683147863 bytes
Compression is 0.0%
Took 2 min 2 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to