Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/323/
2 tests failed. FAILED: org.apache.solr.cloud.HttpPartitionTest.test Error Message: Doc with id=2 not found in http://127.0.0.1:58230/nrf/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null} Stack Trace: java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:58230/nrf/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null} at __randomizedtesting.SeedInfo.seed([5CDCB785D70B83AE:D488885F79F7EE56]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:620) at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:575) at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:523) at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:136) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI Error Message: Error from server at https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1: ClusterState says we are the leader (https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1), but locally we don't think so. Request came from null Stack Trace: org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1: ClusterState says we are the leader (https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1), but locally we don't think so. Request came from null at __randomizedtesting.SeedInfo.seed([5CDCB785D70B83AE:14A9C331D138AC3B]:0) at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:800) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1244) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1115) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1054) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160) at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:521) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1: ClusterState says we are the leader (https://127.0.0.1:60105/solr/awhollynewcollection_0_shard1_replica1), but locally we don't think so. Request came from null at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387) at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:777) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ... 1 more Build Log: [...truncated 12064 lines...] [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/init-core-data-001 [junit4] 2> 1160826 WARN (SUITE-HttpPartitionTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1 [junit4] 2> 1160826 INFO (SUITE-HttpPartitionTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields [junit4] 2> 1160833 INFO (SUITE-HttpPartitionTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776) [junit4] 2> 1160833 INFO (SUITE-HttpPartitionTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /nrf/ [junit4] 2> 1160834 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1160842 INFO (Thread-6975) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1160842 INFO (Thread-6975) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1160942 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkTestServer start zk server on port:37543 [junit4] 2> 1161031 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1161033 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 1161035 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1161036 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1161037 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1161038 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1161040 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1161041 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1161042 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1161043 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1161045 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1161308 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/cores/collection1 [junit4] 2> 1161316 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 1161317 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51ed1a5{/nrf,null,AVAILABLE} [junit4] 2> 1161331 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5bd4b936{HTTP/1.1,[http/1.1]}{127.0.0.1:३८०२०} [junit4] 2> 1161331 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server Started @११७०६३७ms [junit4] 2> 1161331 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/tempDir-001/control/data, hostContext=/nrf, hostPort=58230, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/cores} [junit4] 2> 1161335 ERROR (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1161335 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.6.0 [junit4] 2> 1161336 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1161336 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1161336 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-04-06T21:30:35.069Z [junit4] 2> 1161386 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1161386 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/solr.xml [junit4] 2> 1161403 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1161406 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37543/solr [junit4] 2> 1161429 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15b452d16d70003, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> 1161580 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1161581 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58230_nrf [junit4] 2> 1161586 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.Overseer Overseer (id=97747876877631492-127.0.0.1:58230_nrf-n_0000000000) starting [junit4] 2> 1161655 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58230_nrf [junit4] 2> 1161663 INFO (OverseerStateUpdate-97747876877631492-127.0.0.1:58230_nrf-n_0000000000) [n:127.0.0.1:58230_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1161930 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/cores [junit4] 2> 1161931 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:58230_nrf ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 1161939 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 1161974 INFO (OverseerStateUpdate-97747876877631492-127.0.0.1:58230_nrf-n_0000000000) [n:127.0.0.1:58230_nrf ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1162992 WARN (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1162995 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0 [junit4] 2> 1163330 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1163795 WARN (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 1163800 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 1163824 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection, trusted=true [junit4] 2> 1163824 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 1163824 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/control-001/cores/collection1/data/] [junit4] 2> 1163825 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c983c60 [junit4] 2> 1163827 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@230936ac [junit4] 2> 1163835 WARN (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 1163901 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1163901 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1163902 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 1163902 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 1163902 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=58.1611328125, floorSegmentMB=0.513671875, forceMergeDeletesPctAllowed=8.727282406119368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43470122326648164 [junit4] 2> 1163903 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@251e9d96[collection1] main] [junit4] 2> 1163904 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1163905 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1163905 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1163906 INFO (coreLoadExecutor-2824-thread-1-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1563966033246552064 [junit4] 2> 1163910 INFO (searcherExecutor-2825-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@251e9d96[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58230/nrf/collection1/ [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58230/nrf/collection1/ has no replicas [junit4] 2> 1163915 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 1163931 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58230/nrf/collection1/ shard1 [junit4] 2> 1164099 INFO (coreZkRegister-2817-thread-1-processing-n:127.0.0.1:58230_nrf x:collection1 c:control_collection) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 1164340 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1164349 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37543/solr ready [junit4] 2> 1164349 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1165333 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/cores/collection1 [junit4] 2> 1165334 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001 [junit4] 2> 1165340 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 1165407 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45aa5647{/nrf,null,AVAILABLE} [junit4] 2> 1165408 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@64e20b74{HTTP/1.1,[http/1.1]}{127.0.0.1:३४६८०} [junit4] 2> 1165408 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server Started @११७४७१४ms [junit4] 2> 1165408 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/nrf, hostPort=48194, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/cores} [junit4] 2> 1165409 ERROR (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1165409 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.6.0 [junit4] 2> 1165409 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1165409 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1165409 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-04-06T21:30:39.142Z [junit4] 2> 1165412 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1165412 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/solr.xml [junit4] 2> 1165422 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1165426 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37543/solr [junit4] 2> 1165446 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:48194_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1165449 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:48194_nrf ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1165459 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:48194_nrf ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48194_nrf [junit4] 2> 1165466 INFO (zkCallback-1406-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1165466 INFO (zkCallback-1402-thread-3-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1165467 INFO (zkCallback-1411-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1166591 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:48194_nrf ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/cores [junit4] 2> 1166591 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:48194_nrf ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 1166592 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 1166691 INFO (OverseerStateUpdate-97747876877631492-127.0.0.1:58230_nrf-n_0000000000) [n:127.0.0.1:58230_nrf ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 1167779 WARN (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1167779 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0 [junit4] 2> 1167939 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1169041 WARN (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 1169056 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 1169100 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true [junit4] 2> 1169101 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 1169101 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-1-001/cores/collection1/data/] [junit4] 2> 1169105 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c983c60 [junit4] 2> 1169110 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2e0072fc [junit4] 2> 1169137 WARN (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 1169295 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1169295 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1169297 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 1169297 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 1169335 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=58.1611328125, floorSegmentMB=0.513671875, forceMergeDeletesPctAllowed=8.727282406119368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43470122326648164 [junit4] 2> 1169335 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ad1738a[collection1] main] [junit4] 2> 1169337 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1169337 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1169337 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1169339 INFO (searcherExecutor-2836-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ad1738a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1169339 INFO (coreLoadExecutor-2835-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1563966038943465472 [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48194/nrf/collection1/ [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48194/nrf/collection1/ has no replicas [junit4] 2> 1169360 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 1169367 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48194/nrf/collection1/ shard2 [junit4] 2> 1169524 INFO (coreZkRegister-2830-thread-1-processing-n:127.0.0.1:48194_nrf x:collection1 c:collection1) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 1170996 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/cores/collection1 [junit4] 2> 1170996 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001 [junit4] 2> 1170997 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 1171297 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3b4013d4{/nrf,null,AVAILABLE} [junit4] 2> 1171297 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@167d630d{HTTP/1.1,[http/1.1]}{127.0.0.1:३८११३} [junit4] 2> 1171297 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server Started @११८०६०३ms [junit4] 2> 1171298 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/nrf, hostPort=47630, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/cores} [junit4] 2> 1171298 ERROR (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1171325 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.6.0 [junit4] 2> 1171326 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1171326 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1171326 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-04-06T21:30:45.059Z [junit4] 2> 1171402 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1171402 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/solr.xml [junit4] 2> 1171444 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1171490 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37543/solr [junit4] 2> 1171812 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:47630_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 1171814 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:47630_nrf ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1171818 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:47630_nrf ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47630_nrf [junit4] 2> 1171820 INFO (zkCallback-1406-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1171851 INFO (zkCallback-1402-thread-3-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1171851 INFO (zkCallback-1411-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1171917 INFO (zkCallback-1417-thread-2-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1172922 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:47630_nrf ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/cores [junit4] 2> 1172922 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:47630_nrf ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 1172953 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 1172957 INFO (OverseerStateUpdate-97747876877631492-127.0.0.1:58230_nrf-n_0000000000) [n:127.0.0.1:58230_nrf ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1173178 WARN (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1173179 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0 [junit4] 2> 1173404 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1174864 WARN (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 1174900 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 1175043 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true [junit4] 2> 1175044 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 1175044 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-2-001/cores/collection1/data/] [junit4] 2> 1175044 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c983c60 [junit4] 2> 1175180 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6656d9ea [junit4] 2> 1175255 WARN (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 1175681 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1175681 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1175682 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 1175682 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 1175689 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=58.1611328125, floorSegmentMB=0.513671875, forceMergeDeletesPctAllowed=8.727282406119368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43470122326648164 [junit4] 2> 1175694 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@29ff4172[collection1] main] [junit4] 2> 1175696 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1175696 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1175696 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1175698 INFO (searcherExecutor-2847-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@29ff4172[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1175698 INFO (coreLoadExecutor-2846-thread-1-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1563966045611360256 [junit4] 2> 1175715 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1175715 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1175715 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47630/nrf/collection1/ [junit4] 2> 1175715 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1175716 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47630/nrf/collection1/ has no replicas [junit4] 2> 1175716 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 1175722 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47630/nrf/collection1/ shard1 [junit4] 2> 1175873 INFO (coreZkRegister-2841-thread-1-processing-n:127.0.0.1:47630_nrf x:collection1 c:collection1) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 1177463 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/cores/collection1 [junit4] 2> 1177464 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001 [junit4] 2> 1177465 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 1177843 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@328cc674{/nrf,null,AVAILABLE} [junit4] 2> 1177843 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@44fe1d52{HTTP/1.1,[http/1.1]}{127.0.0.1:४४०५७} [junit4] 2> 1177843 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.e.j.s.Server Started @११८७१४९ms [junit4] 2> 1177843 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/nrf, hostPort=50847, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/cores} [junit4] 2> 1177844 ERROR (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1177874 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.6.0 [junit4] 2> 1177874 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1177874 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1177875 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-04-06T21:30:51.607Z [junit4] 2> 1178019 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1178019 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/solr.xml [junit4] 2> 1178168 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1178231 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37543/solr [junit4] 2> 1178263 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:50847_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1178293 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:50847_nrf ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1178315 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:50847_nrf ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50847_nrf [junit4] 2> 1178319 INFO (zkCallback-1417-thread-2-processing-n:127.0.0.1:47630_nrf) [n:127.0.0.1:47630_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1178320 INFO (zkCallback-1406-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1178320 INFO (zkCallback-1411-thread-1-processing-n:127.0.0.1:48194_nrf) [n:127.0.0.1:48194_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1178321 INFO (zkCallback-1402-thread-3-processing-n:127.0.0.1:58230_nrf) [n:127.0.0.1:58230_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1178331 INFO (zkCallback-1423-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1179755 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:50847_nrf ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/cores [junit4] 2> 1179755 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [n:127.0.0.1:50847_nrf ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 1179758 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 1179760 INFO (OverseerStateUpdate-97747876877631492-127.0.0.1:58230_nrf-n_0000000000) [n:127.0.0.1:58230_nrf ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 1179851 WARN (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1179852 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0 [junit4] 2> 1179880 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1183213 WARN (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead. [junit4] 2> 1183221 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id [junit4] 2> 1183266 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true [junit4] 2> 1183266 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 1183266 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_5CDCB785D70B83AE-001/shard-3-001/cores/collection1/data/] [junit4] 2> 1183267 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7c983c60 [junit4] 2> 1183291 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5e880da7 [junit4] 2> 1183345 WARN (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 1183827 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1183827 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1183828 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 1183828 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 1183838 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=58.1611328125, floorSegmentMB=0.513671875, forceMergeDeletesPctAllowed=8.727282406119368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43470122326648164 [junit4] 2> 1183839 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@763b69f2[collection1] main] [junit4] 2> 1183843 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1183860 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1183860 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1183863 INFO (searcherExecutor-2858-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 c:collection1) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@763b69f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1183864 INFO (coreLoadExecutor-2857-thread-1-processing-n:127.0.0.1:50847_nrf) [n:127.0.0.1:50847_nrf c:collection1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1563966054174031872 [junit4] 2> 1183888 INFO (coreZkRegister-2852-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 c:collection1) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1 [junit4] 2> 1183931 INFO (updateExecutor-1420-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 1183970 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true [junit4] 2> 1183981 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]] [junit4] 2> 1183981 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1] [junit4] 2> 1183981 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4] 2> 1183981 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:48194/nrf/collection1/] and I am [http://127.0.0.1:50847/nrf/collection1/] [junit4] 2> 1184010 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:48194/nrf]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:50847_nrf&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] [junit4] 2> 1184042 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49462,localport=48194], receiveBufferSize:531000 [junit4] 2> 1184142 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34680,localport=57392], receiveBufferSize=530904 [junit4] 2> 1184323 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test [junit4] 2> 1184323 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt [junit4] 2> 1184323 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000 [junit4] 2> 1184325 INFO (qtp2062436483-12635) [n:127.0.0.1:48194_nrf ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true [junit4] 2> 1184336 INFO (qtp2062436483-12635) [n:127.0.0.1:48194_nrf ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering [junit4] 2> 1184336 INFO (qtp2062436483-12635) [n:127.0.0.1:48194_nrf ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:50847_nrf, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:50847/nrf","node_name":"127.0.0.1:50847_nrf","state":"recovering"} [junit4] 2> 1184337 INFO (qtp2062436483-12635) [n:127.0.0.1:48194_nrf ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds. [junit4] 2> 1184337 INFO (qtp2062436483-12635) [n:127.0.0.1:48194_nrf ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:50847_nrf&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=11 [junit4] 2> 1184838 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:48194/nrf/collection1/] - recoveringAfterStartup=[true] [junit4] 2> 1184838 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:50847/nrf START replicas=[http://127.0.0.1:48194/nrf/collection1/] nUpdates=100 [junit4] 2> 1184854 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49467,localport=48194], receiveBufferSize:531000 [junit4] 2> 1184905 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34680,localport=57397], receiveBufferSize=530904 [junit4] 2> 1184934 INFO (qtp2062436483-12638) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0} [junit4] 2> 1184935 INFO (qtp2062436483-12638) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp=/nrf path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 1184978 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:34.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0} [junit4] 2> 1184978 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync [junit4] 2> 1184978 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 1184978 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 1184993 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 1184993 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful. [junit4] 2> 1184994 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync. [junit4] 2> 1184994 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy No replay needed. [junit4] 2> 1184994 INFO (recoveryExecutor-1421-thread-1-processing-n:127.0.0.1:50847_nrf x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Registering as Active after recovery. [junit4] 2> 1185326 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1 [junit4] 2> 1185327 INFO (SocketProxy-Acceptor-58230) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50291,localport=58230], receiveBufferSize:531000 [junit4] 2> 1185399 INFO (SocketProxy-Acceptor-58230) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38020,localport=49698], receiveBufferSize=530904 [junit4] 2> 1185438 INFO (qtp2084098962-12600) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 1185444 INFO (qtp2084098962-12600) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 1185446 INFO (qtp2084098962-12600) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 1185446 INFO (qtp2084098962-12600) [n:127.0.0.1:58230_nrf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/nrf path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 8 [junit4] 2> 1185449 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38021,localport=47630], receiveBufferSize:531000 [junit4] 2> 1185483 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38113,localport=42169], receiveBufferSize=530904 [junit4] 2> 1185853 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38023,localport=47630], receiveBufferSize:531000 [junit4] 2> 1185854 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49477,localport=48194], receiveBufferSize:531000 [junit4] 2> 1185867 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38113,localport=42171], receiveBufferSize=530904 [junit4] 2> 1185868 INFO (SocketProxy-Acceptor-50847) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=58380,localport=50847], receiveBufferSize:531000 [junit4] 2> 1185882 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34680,localport=57407], receiveBufferSize=530904 [junit4] 2> 1185883 INFO (SocketProxy-Acceptor-50847) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44057,localport=34864], receiveBufferSize=530904 [junit4] 2> 1185890 INFO (qtp4756037-12663) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 1185903 INFO (qtp4756037-12663) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 1185904 INFO (qtp4756037-12663) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 1185904 INFO (qtp4756037-12663) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/nrf path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:47630/nrf/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 13 [junit4] 2> 1185905 INFO (qtp2062436483-12636) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 1185905 INFO (qtp2062436483-12636) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 1185905 INFO (qtp2062436483-12636) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 1185905 INFO (qtp2062436483-12636) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/nrf path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:47630/nrf/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0 [junit4] 2> 1185906 INFO (qtp1975123412-12695) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 1185906 INFO (qtp1975123412-12695) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 1185907 INFO (qtp1975123412-12695) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 1185907 INFO (qtp1975123412-12695) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/nrf path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:47630/nrf/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0 [junit4] 2> 1185907 INFO (qtp4756037-12665) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/nrf path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 350 [junit4] 2> 1185908 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49481,localport=48194], receiveBufferSize:531000 [junit4] 2> 1185918 INFO (SocketProxy-Acceptor-48194) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34680,localport=57411], receiveBufferSize=530904 [junit4] 2> 1185922 INFO (qtp2062436483-12637) [n:127.0.0.1:48194_nrf c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp=/nrf path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0 [junit4] 2> 1185924 INFO (SocketProxy-Acceptor-50847) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=58384,localport=50847], receiveBufferSize:531000 [junit4] 2> 1185925 INFO (SocketProxy-Acceptor-50847) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44057,localport=34868], receiveBufferSize=530904 [junit4] 2> 1185926 INFO (qtp1975123412-12693) [n:127.0.0.1:50847_nrf c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.S.Request [collection1] webapp=/nrf path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0 [junit4] 2> 1185927 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38033,localport=47630], receiveBufferSize:531000 [junit4] 2> 1185928 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38113,localport=42181], receiveBufferSize=530904 [junit4] 2> 1185934 INFO (qtp4756037-12668) [n:127.0.0.1:47630_nrf c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.S.Request [collection1] webapp=/nrf path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0 [junit4] 2> 1187935 INFO (TEST-HttpPartitionTest.test-seed#[5CDCB785D70B83AE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection with stateFormat=1: c8n_crud_1x2 [junit4] 2> 1187937 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38046,localport=47630], receiveBufferSize:531000 [junit4] 2> 1187984 INFO (SocketProxy-Acceptor-47630) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38113,localport=42194], receiveBufferSize=530904 [junit4] 2> 1188011 INFO (qtp4756037-12668) [n:12 [...truncated too long message...] atanode Uuid e82e23b8-563c-41c4-b049-1581e5937180) service to localhost/127.0.0.1:34669 interrupted [junit4] 2> 2381149 WARN (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_5CDCB785D70B83AE-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_5CDCB785D70B83AE-001/tempDir-002/hdfsBaseDir/data/data2/]] heartbeating to localhost/127.0.0.1:34669) [ ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1828252072-10.41.0.5-1491515247639 (Datanode Uuid e82e23b8-563c-41c4-b049-1581e5937180) service to localhost/127.0.0.1:34669 [junit4] 2> 2381150 INFO (org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@7cc9ffc0) [ ] BlockStateChange BLOCK* BlockManager: ask 127.0.0.1:54485 to delete [blk_1073742158_1334] [junit4] 2> 2381187 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 [junit4] 2> 2381289 ERROR (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal [junit4] 2> java.lang.reflect.InvocationTargetException [junit4] 2> at sun.reflect.GeneratedMethodAccessor106.invoke(Unknown Source) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) [junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111) [junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144) [junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:401) [junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:194) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151) [junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804) [junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595) [junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813) [junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430) [junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415) [junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) [junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594) [junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72) [junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872) [junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726) [junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:203) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:77) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> Caused by: java.lang.NullPointerException [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203) [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729) [junit4] 2> ... 53 more [junit4] 2> 2381295 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36677 36677 [junit4] 2> 2381295 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[5CDCB785D70B83AE]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_5CDCB785D70B83AE-001 [junit4] 2> Apr 06, 2017 9:50:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 19 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {_version_=FSTOrd50, id=FST50}, docValues:{}, maxPointsInLeafNode=664, maxMBSortInHeap=6.728454863321396, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=zh-CN, timezone=America/Resolute [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=4,threads=4,free=171916864,total=525336576 [junit4] 2> NOTE: All tests run in this JVM: [LeaderInitiatedRecoveryOnCommitTest, MergeStrategyTest, DocumentAnalysisRequestHandlerTest, DistribJoinFromCollectionTest, TestDFISimilarityFactory, BlockJoinFacetRandomTest, TestLockTree, TestDistributedSearch, TestFaceting, TestPathTrie, DateFieldTest, BufferStoreTest, TestSolrCloudWithDelegationTokens, UniqFieldsUpdateProcessorFactoryTest, TriLevelCompositeIdRoutingTest, TestSolrConfigHandlerCloud, PropertiesRequestHandlerTest, TestStressCloudBlindAtomicUpdates, HighlighterConfigTest, TestObjectReleaseTracker, TestReplicationHandler, TestInitQParser, TestExclusionRuleCollectionAccess, TestBinaryResponseWriter, TestManagedResourceStorage, TestHighFrequencyDictionaryFactory, QueryElevationComponentTest, TestSolr4Spatial, DefaultValueUpdateProcessorTest, TestConfigSets, TestSolrDeletionPolicy2, OverseerCollectionConfigSetProcessorTest, HdfsCollectionsAPIDistributedZkTest] [junit4] Completed [248/703 (2!)] on J0 in 216.12s, 21 tests, 1 error <<< FAILURES! [...truncated 44817 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
