Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2044/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
        at 
__randomizedtesting.SeedInfo.seed([25252F3F7F3BFEED:A4C3A12708649ED1]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
        at 
org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11167 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/init-core-data-001
   [junit4]   2> 1350178 T3785 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(false) and clientAuth (true)
   [junit4]   2> 1350178 T3785 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /
   [junit4]   2> 1350185 T3785 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 1350186 T3785 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1350187 T3786 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 1350286 T3785 oasc.ZkTestServer.run start zk server on 
port:28135
   [junit4]   2> 1350287 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1350292 T3792 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@298533db 
name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350292 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1350292 T3785 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1350296 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1350298 T3794 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1fe8dfe4 
name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350298 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1350298 T3785 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 1350301 T3785 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 1350303 T3785 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 1350305 T3785 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 1350307 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 1350308 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 1350312 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 1350312 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 1350415 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1350416 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1350419 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 1350419 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 1350422 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 1350422 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 1350425 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 1350426 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 1350428 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1350429 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 1350431 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1350432 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 1350434 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1350435 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1350437 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1350438 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 1350440 T3785 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 1350441 T3785 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 1351498 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1351502 T3785 oejs.AbstractConnector.doStart Started 
[email protected]:45148
   [junit4]   2> 1351503 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1351503 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1351503 T3785 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002
   [junit4]   2> 1351504 T3785 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/'
   [junit4]   2> 1351535 T3785 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/solr.xml
   [junit4]   2> 1351607 T3785 oasc.CoreContainer.<init> New CoreContainer 
1891131755
   [junit4]   2> 1351607 T3785 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/]
   [junit4]   2> 1351608 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1351609 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1351609 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1351611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1351611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1351612 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1351612 T3785 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1351613 T3785 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1351613 T3785 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1351613 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1351614 T3785 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:28135/solr
   [junit4]   2> 1351614 T3785 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1351615 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1351617 T3805 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5903f19d 
name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1351618 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1351620 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1351621 T3807 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2b38737d 
name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1351621 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1351623 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 1351625 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 1351627 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 1351629 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 1351631 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 1351633 T3785 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1351634 T3785 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45148_
   [junit4]   2> 1351635 T3785 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:45148_
   [junit4]   2> 1351637 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 1351638 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 1351641 T3785 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:45148_
   [junit4]   2> 1351641 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 1351642 T3785 oasc.Overseer.start Overseer 
(id=92204831550996483-127.0.0.1:45148_-n_0000000000) starting
   [junit4]   2> 1351644 T3785 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 1351650 T3809 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 1351651 T3785 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 1351653 T3785 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 1351654 T3785 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1351656 T3808 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 1351659 T3810 oasc.ZkController.publish publishing 
core=collection1 state=down collection=control_collection
   [junit4]   2> 1351660 T3810 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1351661 T3810 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1351661 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1351662 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1351663 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"http://127.0.0.1:45148";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:45148_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 1351663 T3808 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
control_collection with shards [shard1]
   [junit4]   2> 1351663 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1351665 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1351666 T3811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1352661 T3810 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 1352662 T3810 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:control_collection
   [junit4]   2> 1352663 T3810 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1352663 T3810 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 1352664 T3810 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 1352664 T3810 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/'
   [junit4]   2> 1352666 T3810 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1352666 T3810 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/README'
 to classloader
   [junit4]   2> 1352667 T3810 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1352734 T3810 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 1352782 T3810 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1352884 T3810 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1352897 T3810 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 1353333 T3810 oass.ByteField.init WARN ByteField is deprecated 
and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1353334 T3810 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1353335 T3810 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1353348 T3810 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1353351 T3810 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1353366 T3810 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1353371 T3810 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1353376 T3810 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1353377 T3810 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1353377 T3810 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1353377 T3810 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1353378 T3810 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1353379 T3810 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1353379 T3810 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection control_collection
   [junit4]   2> 1353379 T3810 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1353380 T3810 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/,
 
dataDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/
   [junit4]   2> 1353380 T3810 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1353381 T3810 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data
   [junit4]   2> 1353381 T3810 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index/
   [junit4]   2> 1353381 T3810 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1353382 T3810 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index
   [junit4]   2> 1353382 T3810 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, 
floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, 
segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.15751729419213786
   [junit4]   2> 1353384 T3810 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@404731cc
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b33e7db)),segFN=segments_1,generation=1}
   [junit4]   2> 1353384 T3810 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1353389 T3810 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1353391 T3810 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1353391 T3810 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1353392 T3810 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1353392 T3810 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1353392 T3810 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1353393 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1353395 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1353395 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1353396 T3810 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1353415 T3810 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1353421 T3810 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1353421 T3810 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1353422 T3810 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1353422 T3810 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@404731cc
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b33e7db)),segFN=segments_1,generation=1}
   [junit4]   2> 1353423 T3810 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1353423 T3810 oass.SolrIndexSearcher.<init> Opening 
Searcher@381a9c8f[collection1] main
   [junit4]   2> 1353423 T3810 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 1353424 T3810 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 1353425 T3810 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1353425 T3810 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1353425 T3810 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1353426 T3810 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353426 T3810 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1353427 T3810 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353427 T3810 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 1353430 T3810 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1353430 T3810 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353430 T3810 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1353434 T3812 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@381a9c8f[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1353436 T3810 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 1353437 T3815 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:45148 collection:control_collection 
shard:shard1
   [junit4]   2> 1353438 T3785 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1353438 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1353438 T3815 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1353439 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1353441 T3817 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2defac6e 
name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1353441 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1353443 T3785 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1353445 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 1353445 T3785 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 1353447 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353447 T3815 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 1353448 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C591 name=collection1 
org.apache.solr.core.SolrCore@4762b36d url=http://127.0.0.1:45148/collection1 
node=127.0.0.1:45148_ C591_STATE=coll:control_collection core:collection1 
props:{state=down, base_url=http://127.0.0.1:45148, core=collection1, 
node_name=127.0.0.1:45148_}
   [junit4]   2> 1353448 T3815 C591 P45148 oasc.SyncStrategy.sync Sync replicas 
to http://127.0.0.1:45148/collection1/
   [junit4]   2> 1353448 T3815 C591 P45148 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 1353448 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1353449 T3815 C591 P45148 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:45148/collection1/ has no replicas
   [junit4]   2> 1353449 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: http://127.0.0.1:45148/collection1/ shard1
   [junit4]   2> 1353449 T3815 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 1353451 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353452 T3811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353452 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353456 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1353458 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353561 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353561 T3811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353608 T3815 oasc.ZkController.register We are 
http://127.0.0.1:45148/collection1/ and leader is 
http://127.0.0.1:45148/collection1/
   [junit4]   2> 1353609 T3815 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=http://127.0.0.1:45148
   [junit4]   2> 1353609 T3815 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 1353609 T3815 oasc.ZkController.publish publishing 
core=collection1 state=active collection=control_collection
   [junit4]   2> 1353609 T3815 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1353611 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353611 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353611 T3815 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1353611 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353613 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1353613 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"http://127.0.0.1:45148";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:45148_",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node1"}
   [junit4]   2> 1353615 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1353717 T3820 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353717 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1354502 T3785 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 1354503 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1354505 T3785 oejs.AbstractConnector.doStart Started 
[email protected]:49062
   [junit4]   2> 1354506 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1354506 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1354507 T3785 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003
   [junit4]   2> 1354507 T3785 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/'
   [junit4]   2> 1354538 T3785 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/solr.xml
   [junit4]   2> 1354609 T3785 oasc.CoreContainer.<init> New CoreContainer 
1557727018
   [junit4]   2> 1354609 T3785 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/]
   [junit4]   2> 1354610 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1354613 T3785 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1354613 T3785 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1354613 T3785 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1354614 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1354614 T3785 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:28135/solr
   [junit4]   2> 1354614 T3785 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1354615 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1354617 T3831 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2c658605 
name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1354617 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1354620 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1354621 T3833 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@549a1c0a 
name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1354621 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1354627 T3785 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1355630 T3785 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49062_
   [junit4]   2> 1355631 T3785 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:49062_
   [junit4]   2> 1355634 T3818 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 1355634 T3834 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 1355634 T3820 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 1355642 T3835 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 1355642 T3835 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1355643 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1355643 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1355643 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1355643 T3835 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1355645 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1355646 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"http://127.0.0.1:49062";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:49062_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 1355646 T3808 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 1355646 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 1355648 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1355649 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1355649 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1355649 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1356644 T3835 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 1356645 T3835 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 1356646 T3835 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1356646 T3835 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 1356647 T3835 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1356647 T3835 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/'
   [junit4]   2> 1356649 T3835 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1356650 T3835 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/README'
 to classloader
   [junit4]   2> 1356651 T3835 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1356717 T3835 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 1356766 T3835 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1356867 T3835 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1356880 T3835 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 1357309 T3835 oass.ByteField.init WARN ByteField is deprecated 
and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1357310 T3835 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1357311 T3835 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1357324 T3835 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1357327 T3835 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1357341 T3835 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1357346 T3835 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1357351 T3835 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1357352 T3835 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1357352 T3835 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1357352 T3835 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1357353 T3835 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1357353 T3835 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1357354 T3835 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 1357354 T3835 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1357354 T3835 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/,
 
dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/
   [junit4]   2> 1357355 T3835 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1357356 T3835 oasc.CachingDirectoryFactory.get return new 
directory for 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data
   [junit4]   2> 1357356 T3835 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index/
   [junit4]   2> 1357356 T3835 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1357357 T3835 oasc.CachingDirectoryFactory.get return new 
directory for 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index
   [junit4]   2> 1357357 T3835 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, 
floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, 
segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.15751729419213786
   [junit4]   2> 1357358 T3835 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@6ecec741
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e57a8cc)),segFN=segments_1,generation=1}
   [junit4]   2> 1357359 T3835 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1357365 T3835 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1357367 T3835 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1357367 T3835 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1357368 T3835 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1357368 T3835 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1357368 T3835 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1357369 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1357371 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1357371 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1357372 T3835 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1357391 T3835 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1357396 T3835 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1357396 T3835 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1357397 T3835 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1357398 T3835 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@6ecec741
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e57a8cc)),segFN=segments_1,generation=1}
   [junit4]   2> 1357398 T3835 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1357399 T3835 oass.SolrIndexSearcher.<init> Opening 
Searcher@4f76fe59[collection1] main
   [junit4]   2> 1357399 T3835 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 1357400 T3835 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1357400 T3835 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1357401 T3835 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1357401 T3835 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1357401 T3835 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1357402 T3835 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1357403 T3835 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1357403 T3835 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 1357403 T3835 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1357408 T3836 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@4f76fe59[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1357412 T3835 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 1357412 T3839 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:49062 collection:collection1 
shard:shard1
   [junit4]   2> 1357413 T3785 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1357413 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1357413 T3839 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1357419 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 1357421 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357421 T3839 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 1357421 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C592 name=collection1 
org.apache.solr.core.SolrCore@6fc32afd url=http://127.0.0.1:49062/collection1 
node=127.0.0.1:49062_ C592_STATE=coll:collection1 core:collection1 
props:{state=down, base_url=http://127.0.0.1:49062, core=collection1, 
node_name=127.0.0.1:49062_}
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.sync Sync replicas 
to http://127.0.0.1:49062/collection1/
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:49062/collection1/ has no replicas
   [junit4]   2> 1357422 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1357422 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: http://127.0.0.1:49062/collection1/ shard1
   [junit4]   2> 1357423 T3839 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 1357425 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357426 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357426 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357426 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357429 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1357431 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357533 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357534 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357534 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357581 T3839 oasc.ZkController.register We are 
http://127.0.0.1:49062/collection1/ and leader is 
http://127.0.0.1:49062/collection1/
   [junit4]   2> 1357582 T3839 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=http://127.0.0.1:49062
   [junit4]   2> 1357582 T3839 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 1357582 T3839 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 1357582 T3839 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1357584 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357584 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357584 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357585 T3839 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1357585 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1357586 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"http://127.0.0.1:49062";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:49062_",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node1"}
   [junit4]   2> 1357588 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1357690 T3811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357691 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357690 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1358507 T3785 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 1358509 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1358511 T3785 oejs.AbstractConnector.doStart Started 
[email protected]:17538
   [junit4]   2> 1358512 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1358512 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1358512 T3785 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004
   [junit4]   2> 1358513 T3785 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/'
   [junit4]   2> 1358544 T3785 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/solr.xml
   [junit4]   2> 1358598 T3785 oasc.CoreContainer.<init> New CoreContainer 
600420059
   [junit4]   2> 1358599 T3785 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/]
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1358602 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1358602 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1358602 T3785 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1358603 T3785 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1358603 T3785 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1358603 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1358603 T3785 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:28135/solr
   [junit4]   2> 1358604 T3785 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 1358605 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1358606 T3850 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@df6be38 name:ZooKeeperConnection 
Watcher:127.0.0.1:28135 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1358607 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1358609 T3785 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 1358610 T3852 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@619d1d1f 
name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358610 T3785 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 1358616 T3785 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 1359619 T3785 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17538_
   [junit4]   2> 1359620 T3785 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:17538_
   [junit4]   2> 1359623 T3811 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 1359623 T3853 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 1359623 T3834 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 1359623 T3818 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 1359631 T3854 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 1359631 T3854 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1359632 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1359632 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1359632 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1359632 T3854 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 1359633 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1359634 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"http://127.0.0.1:17538";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:17538_",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 1359634 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=2
   [junit4]   2> 1359635 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 1359637 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1359637 T3853 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1360633 T3854 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 1360634 T3854 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 1360635 T3854 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 1360635 T3854 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 1360636 T3854 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1360636 T3854 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/'
   [junit4]   2> 1360638 T3854 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1360638 T3854 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/README'
 to classloader
   [junit4]   2> 1360639 T3854 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1360705 T3854 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 1360754 T3854 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 1360855 T3854 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 1360868 T3854 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 1361296 T3854 oass.ByteField.init WARN ByteField is deprecated 
and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1361298 T3854 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1361298 T3854 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1361312 T3854 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 1361315 T3854 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1361330 T3854 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1361334 T3854 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 1361339 T3854 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1361340 T3854 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1361340 T3854 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1361340 T3854 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1361342 T3854 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 1361342 T3854 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 1361342 T3854 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 1361342 T3854 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1361343 T3854 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/,
 
dataDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/
   [junit4]   2> 1361343 T3854 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1361344 T3854 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data
   [junit4]   2> 1361344 T3854 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index/
   [junit4]   2> 1361345 T3854 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1361345 T3854 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index
   [junit4]   2> 1361346 T3854 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, 
floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, 
segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.15751729419213786
   [junit4]   2> 1361347 T3854 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@33c078fa
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@113f21b5)),segFN=segments_1,generation=1}
   [junit4]   2> 1361347 T3854 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1361353 T3854 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1361354 T3854 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1361354 T3854 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1361356 T3854 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1361356 T3854 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1361356 T3854 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1361357 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 1361359 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 1361360 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1361360 T3854 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1361379 T3854 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1361398 T3854 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 1361398 T3854 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 1361399 T3854 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1361400 T3854 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@33c078fa
 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@113f21b5)),segFN=segments_1,generation=1}
   [junit4]   2> 1361400 T3854 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 1361400 T3854 oass.SolrIndexSearcher.<init> Opening 
Searcher@59a04d51[collection1] main
   [junit4]   2> 1361401 T3854 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 1361402 T3854 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 1361402 T3854 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1361403 T3854 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1361403 T3854 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 1361403 T3854 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1361404 T3854 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1361405 T3854 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1361405 T3854 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 1361405 T3854 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 1361410 T3855 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@59a04d51[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1361413 T3854 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 1361414 T3858 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:17538 collection:collection1 
shard:shard2
   [junit4]   2> 1361415 T3785 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1361415 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 1361415 T3858 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1361421 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard2
   [junit4]   2> 1361422 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361423 T3858 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 1361423 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C593 name=collection1 
org.apache.solr.core.SolrCore@30482074 url=http://127.0.0.1:17538/collection1 
node=127.0.0.1:17538_ C593_STATE=coll:collection1 core:collection1 
props:{state=down, base_url=http://127.0.0.1:17538, core=collection1, 
node_name=127.0.0.1:17538_}
   [junit4]   2> 1361423 T3858 C593 P17538 oasc.SyncStrategy.sync Sync replicas 
to http://127.0.0.1:17538/collection1/
   [junit4]   2> 1361423 T3858 C593 P17538 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 1361424 T3858 C593 P17538 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:17538/collection1/ has no replicas
   [junit4]   2> 1361424 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1361424 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: http://127.0.0.1:17538/collection1/ shard2
   [junit4]   2> 1361424 T3858 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard2
   [junit4]   2> 1361427 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361427 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3853 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361431 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1361433 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361536 T3819 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3853 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361582 T3858 oasc.ZkController.register We are 
http://127.0.0.1:17538/collection1/ and leader is 
http://127.0.0.1:17538/collection1/
   [junit4]   2> 1361583 T3858 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=http://127.0.0.1:17538
   [junit4]   2> 1361583 T3858 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 1361583 T3858 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 1361583 T3858 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 1361585 T3819 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361585 T3820 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361586 T3858 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1361585 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361587 T3808 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 1361587 T3808 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"http://127.0.0.1:17538";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:17538_",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node2"}
   [junit4]   2> 1361590 T3811 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 1361692 T3818 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3834 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3853 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1362647 T3785 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 1362648 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1362650 T3785 oejs.AbstractConnector.doStart Started 
[email protected]:20593
   [junit4]   2> 1362651 T3785 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 1362651 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 1362651 T3785 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005
   [junit4]   2> 1362652 T3785 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/'
   [junit4]   2> 1362683 T3785 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/solr.xml
   [junit4]   2> 1362737 T3785 oasc.CoreContainer.<init> New CoreContainer 
372240636
   [junit4]   2> 1362738 T3785 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/]
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 1362741 T3785 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 1362741 T3785 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1362741 T3785 oasl

[...truncated too long message...]

F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index 
[CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index;done=false>>]
   [junit4]   2> 1404965 T3785 oasc.CachingDirectoryFactory.close Closing 
directory: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index
   [junit4]   2> 1404966 T3785 oasc.SolrCore.close 
[ocptest_shardsplit_shard1_replica1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@2d26e2d8
   [junit4]   2> 1404977 T3785 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 1404977 T3785 oasu.SolrCoreState.decrefSolrCoreState Closing 
SolrCoreState
   [junit4]   2> 1404978 T3785 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1404978 T3785 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1404979 T3785 oasc.SolrCore.closeSearcher 
[ocptest_shardsplit_shard1_replica1] Closing main searcher on request.
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data
 
[CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data;done=false>>]
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.close Closing 
directory: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data
   [junit4]   2> 1404981 T3785 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index
 
[CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index;done=false>>]
   [junit4]   2> 1404981 T3785 oasc.CachingDirectoryFactory.close Closing 
directory: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index
   [junit4]   2> 1404982 T5311 oasc.Overseer$ClusterStateUpdater.run Overseer 
Loop exiting : 127.0.0.1:30909_
   [junit4]   2> 1404984 T5313 
oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read 
the data org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 1406484 T3893 oascc.ZkStateReader$3.process WARN ZooKeeper 
watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1406487 T3785 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 1409911 T3785 oas.SolrTestCaseJ4.tearDown ###Ending 
testDistribSearch
   [junit4]   2> 1409914 T3785 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:28135 28135
   [junit4]   2> 1409956 T3786 oasc.ZkTestServer.send4LetterWord connecting to 
127.0.0.1:28135 28135
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch 
-Dtests.seed=25252F3F7F3BFEED -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=ar_MA -Dtests.timezone=Australia/Queensland 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 59.8s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed 
SPLITSHARD task
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([25252F3F7F3BFEED:A4C3A12708649ED1]:0)
   [junit4]    >        at 
org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    >        at 
org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1409972 T3785 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001
   [junit4]   2> 59798 T3784 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: 
codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=411), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=411)), sim=DefaultSimilarity, locale=ar_MA, 
timezone=Australia/Queensland
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 
(64-bit)/cpus=16,threads=1,free=121036328,total=497025024
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexSearcher, 
TestFieldCollectionResource, SpatialFilterTest, SolrTestCaseJ4Test, 
TestJmxMonitoredMap, TestComponentsName, TestImplicitCoreProperties, 
TestValueSourceCache, TriLevelCompositeIdRoutingTest, TestFastOutputStream, 
ShardRoutingTest, TestDefaultSearchFieldResource, 
DocumentAnalysisRequestHandlerTest, OpenExchangeRatesOrgProviderTest, 
TestFiltering, TestInitQParser, TestCollectionAPI, 
DistributedQueryComponentOptimizationTest, StandardRequestHandlerTest, 
TestNonDefinedSimilarityFactory, DebugComponentTest, 
QueryElevationComponentTest, SyncSliceTest, DocValuesTest, EchoParamsTest, 
SolrIndexConfigTest, CopyFieldTest, DocValuesMissingTest, 
DeleteInactiveReplicaTest, TestManagedResourceStorage, PrimitiveFieldTypeTest, 
MultiTermTest, DistributedSpellCheckComponentTest, HdfsBasicDistributedZkTest, 
IndexSchemaTest, BasicDistributedZk2Test, TestBinaryField, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 60.09s, 1 test, 1 failure <<< FAILURES!

[...truncated 977 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923:
 There were test failures: 411 suites, 1705 tests, 1 failure, 52 ignored (18 
assumptions)

Total time: 125 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 192046337 bytes
Compression is 0.0%
Took 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to