Build: https://builds.apache.org/job/Lucene-Solr-BadApples-NightlyTests-8.x/2/
9 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=146479, name=Thread-13484,
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=146479, name=Thread-13484, state=RUNNABLE,
group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:638)
Caused by: org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:567)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1019)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:635)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured
while waiting response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
at
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:213)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:561)
... 6 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
... 12 more
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=146480, name=Thread-13485,
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=146480, name=Thread-13485, state=RUNNABLE,
group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:41403/y_yfm/collection2_shard5_replica_n23
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:638)
Caused by: org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:41403/y_yfm/collection2_shard5_replica_n23
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:567)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1019)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:635)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured
while waiting response from server at:
http://127.0.0.1:41403/y_yfm/collection2_shard5_replica_n23
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
at
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:213)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:561)
... 6 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
... 12 more
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Captured an uncaught exception in thread: Thread[id=146478, name=Thread-13483,
state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=146478, name=Thread-13483, state=RUNNABLE,
group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:638)
Caused by: org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:567)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1019)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:635)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured
while waiting response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
at
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:213)
at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:561)
... 6 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
... 12 more
FAILED:
org.apache.solr.cloud.autoscaling.sim.TestSimExtremeIndexing.testScaleUp
Error Message:
{numFound=983300000,start=0,docs=[]} expected:<1000000000> but was:<983300000>
Stack Trace:
java.lang.AssertionError: {numFound=983300000,start=0,docs=[]}
expected:<1000000000> but was:<983300000>
at
__randomizedtesting.SeedInfo.seed([57D72FFE59354B91:7689695C551B9530]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at
org.apache.solr.cloud.autoscaling.sim.TestSimExtremeIndexing.testScaleUp(TestSimExtremeIndexing.java:135)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED:
org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testEventQueue
Error Message:
action wasn't interrupted
Stack Trace:
java.lang.AssertionError: action wasn't interrupted
at
__randomizedtesting.SeedInfo.seed([57D72FFE59354B91:9E626D5050528D64]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testEventQueue(TestSimTriggerIntegration.java:757)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.hdfs.HdfsRestartWhileUpdatingTest.test
Error Message:
There are still nodes recoverying - waited for 320 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 320
seconds
at
__randomizedtesting.SeedInfo.seed([57D72FFE59354B91:DF831024F7C92669]:0)
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:195)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:1038)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1595)
at
org.apache.solr.cloud.RestartWhileUpdatingTest.test(RestartWhileUpdatingTest.java:144)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=109823,
name=testExecutor-16411-thread-16, state=RUNNABLE,
group=TGRP-HdfsUnloadDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=109823, name=testExecutor-16411-thread-16,
state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]
Caused by: java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at: http://127.0.0.1:42065
at __randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
at
org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$1(BasicDistributedZkTest.java:659)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured
while waiting response from server at: http://127.0.0.1:42065
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at
org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$1(BasicDistributedZkTest.java:657)
... 4 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
... 9 more
Build Log:
[...truncated 13946 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimExtremeIndexing
[junit4] 2> Creating dataDir:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-8.x/checkout/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestSimExtremeIndexing_57D72FFE59354B91-001/init-core-data-001
[junit4] 2> 1693247 WARN
(SUITE-TestSimExtremeIndexing-seed#[57D72FFE59354B91]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 1693247 INFO
(SUITE-TestSimExtremeIndexing-seed#[57D72FFE59354B91]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1693249 INFO
(SUITE-TestSimExtremeIndexing-seed#[57D72FFE59354B91]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via:
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1693249 INFO
(SUITE-TestSimExtremeIndexing-seed#[57D72FFE59354B91]-worker) [ ]
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1693268 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.SolrTestCaseJ4 ###Starting testScaleUp
[junit4] 2> 1693524 DEBUG
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader:
127.0.0.1:10000_solr
[junit4] 2> 1693525 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and
.scheduled_maintenance triggers
[junit4] 2> 1693525 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode
version 1
[junit4] 2> 1693525 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 1693525 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1693584 DEBUG
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=0
[junit4] 2> 1693586 DEBUG
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
[junit4] 2> 1693586 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history
in memory.
[junit4] 2> 1693616 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
[junit4] 2> 1693636 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1694091 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection
testScaleUp_collection, currentVersion=1
[junit4] 2> 1694092 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=1
[junit4] 2> 1694092 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
[junit4] 2> 1694147 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=2
[junit4] 2> 1694149 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
[junit4] 2> 1695427 DEBUG (simCloudManagerPool-3909-thread-2) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=3
[junit4] 2> 1695480 DEBUG (simCloudManagerPool-3909-thread-2) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
[junit4] 2> 1695557 DEBUG (simCloudManagerPool-3909-thread-6) [ ]
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for
testScaleUp_collection / shard1 (currentVersion=4): {"core_node1":{
[junit4] 2> "core":"testScaleUp_collection_shard1_replica_n1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"testScaleUp_collection",
[junit4] 2> "node_name":"127.0.0.1:10072_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 1695593 DEBUG (simCloudManagerPool-3909-thread-3) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=4
[junit4] 2> 1695593 DEBUG (simCloudManagerPool-3909-thread-3) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
[junit4] 2> 1695613 DEBUG (simCloudManagerPool-3909-thread-4) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=5
[junit4] 2> 1695650 DEBUG (simCloudManagerPool-3909-thread-4) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
[junit4] 2> 1695662 DEBUG (simCloudManagerPool-3909-thread-1) [ ]
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection
testScaleUp_collection, currentVersion=6
[junit4] 2> 1695719 DEBUG (simCloudManagerPool-3909-thread-7) [ ]
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for
testScaleUp_collection / shard2 (currentVersion=6): {"core_node3":{
[junit4] 2> "core":"testScaleUp_collection_shard2_replica_n3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"testScaleUp_collection",
[junit4] 2> "node_name":"127.0.0.1:10059_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "leader":"true",
[junit4] 2> "SEARCHER.searcher.maxDoc":0,
[junit4] 2> "SEARCHER.searcher.deletedDocs":0,
[junit4] 2> "INDEX.sizeInBytes":10240,
[junit4] 2> "state":"active",
[junit4] 2> "INDEX.sizeInGB":9.5367431640625E-6,
[junit4] 2> "SEARCHER.searcher.numDocs":0}}
[junit4] 2> 1695751 DEBUG (simCloudManagerPool-3909-thread-5) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=6
[junit4] 2> 1695751 DEBUG (simCloudManagerPool-3909-thread-5) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
[junit4] 2> 1695751 DEBUG
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states,
currentVersion=7
[junit4] 2> 1695752 DEBUG
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
[junit4] 2> 1695795 DEBUG (simCloudManagerPool-3909-thread-8) [ ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1695795 DEBUG (simCloudManagerPool-3909-thread-8) [ ]
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version
2
[junit4] 2> 1695797 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1695798 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
[junit4] 2> 1695798 DEBUG (Simulated OverseerAutoScalingTriggerThread) [
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1696024 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 200,000
[junit4] 2> 1696174 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 400,000
[junit4] 2> 1696188 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 600,000
[junit4] 2> 1696224 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 800,000
[junit4] 2> 1696244 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 1,000,000
[junit4] 2> 1696277 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 1,200,000
[junit4] 2> 1696317 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 1,400,000
[junit4] 2> 1696321 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 1,600,000
[junit4] 2> 1696411 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 1,800,000
[junit4] 2> 1696448 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 2,000,000
[junit4] 2> 1696467 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 2,200,000
[junit4] 2> 1696487 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 2,400,000
[junit4] 2> 1696499 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 2,600,000
[junit4] 2> 1696534 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 2,800,000
[junit4] 2> 1696551 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 3,000,000
[junit4] 2> 1696572 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 3,200,000
[junit4] 2> 1696587 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 3,400,000
[junit4] 2> 1696606 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 3,600,000
[junit4] 2> 1696607 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 3,800,000
[junit4] 2> 1696607 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 4,000,000
[junit4] 2> 1696608 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 4,200,000
[junit4] 2> 1696608 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 4,400,000
[junit4] 2> 1696609 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 4,600,000
[junit4] 2> 1696609 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 4,800,000
[junit4] 2> 1696622 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 5,000,000
[junit4] 2> 1696623 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 5,200,000
[junit4] 2> 1696623 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 5,400,000
[junit4] 2> 1696624 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 5,600,000
[junit4] 2> 1696625 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 5,800,000
[junit4] 2> 1696625 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 6,000,000
[junit4] 2> 1696642 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 6,200,000
[junit4] 2> 1696643 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 6,400,000
[junit4] 2> 1696643 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 6,600,000
[junit4] 2> 1696644 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 6,800,000
[junit4] 2> 1696645 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 7,000,000
[junit4] 2> 1696659 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 7,200,000
[junit4] 2> 1696731 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 7,400,000
[junit4] 2> 1696748 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 7,600,000
[junit4] 2> 1696768 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 7,800,000
[junit4] 2> 1696805 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 8,000,000
[junit4] 2> 1696840 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 8,200,000
[junit4] 2> 1696877 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 8,400,000
[junit4] 2> 1696898 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 8,600,000
[junit4] 2> 1696902 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 8,800,000
[junit4] 2> 1696922 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 9,000,000
[junit4] 2> 1696938 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 9,200,000
[junit4] 2> 1696939 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 9,400,000
[junit4] 2> 1696939 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 9,600,000
[junit4] 2> 1696954 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 9,800,000
[junit4] 2> 1696971 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 10,000,000
[junit4] 2> 1696988 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 10,200,000
[junit4] 2> 1697023 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 10,400,000
[junit4] 2> 1697023 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 10,600,000
[junit4] 2> 1697043 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 10,800,000
[junit4] 2> 1697048 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 11,000,000
[junit4] 2> 1697064 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 11,200,000
[junit4] 2> 1697076 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 11,400,000
[junit4] 2> 1697077 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 11,600,000
[junit4] 2> 1697085 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 11,800,000
[junit4] 2> 1697101 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 12,000,000
[junit4] 2> 1697117 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 12,200,000
[junit4] 2> 1697204 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 12,400,000
[junit4] 2> 1697205 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 12,600,000
[junit4] 2> 1697222 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 12,800,000
[junit4] 2> 1697222 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 13,000,000
[junit4] 2> 1697223 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 13,200,000
[junit4] 2> 1697223 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 13,400,000
[junit4] 2> 1697223 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 13,600,000
[junit4] 2> 1697224 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 13,800,000
[junit4] 2> 1697224 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 14,000,000
[junit4] 2> 1697225 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 14,200,000
[junit4] 2> 1697225 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 14,400,000
[junit4] 2> 1697238 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 14,600,000
[junit4] 2> 1697238 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 14,800,000
[junit4] 2> 1697239 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 15,000,000
[junit4] 2> 1697239 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 15,200,000
[junit4] 2> 1697240 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 15,400,000
[junit4] 2> 1697240 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 15,600,000
[junit4] 2> 1697242 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 15,800,000
[junit4] 2> 1697263 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 16,000,000
[junit4] 2> 1697263 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 16,200,000
[junit4] 2> 1697296 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 16,400,000
[junit4] 2> 1697296 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 16,600,000
[junit4] 2> 1697297 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 16,800,000
[junit4] 2> 1697323 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 17,000,000
[junit4] 2> 1697327 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 17,200,000
[junit4] 2> 1697332 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 17,400,000
[junit4] 2> 1697332 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 17,600,000
[junit4] 2> 1697333 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 17,800,000
[junit4] 2> 1697333 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 18,000,000
[junit4] 2> 1697334 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 18,200,000
[junit4] 2> 1697334 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 18,400,000
[junit4] 2> 1697334 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 18,600,000
[junit4] 2> 1697368 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 18,800,000
[junit4] 2> 1697376 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 19,000,000
[junit4] 2> 1697404 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 19,200,000
[junit4] 2> 1697405 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 19,400,000
[junit4] 2> 1697405 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 19,600,000
[junit4] 2> 1697406 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 19,800,000
[junit4] 2> 1697406 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 20,000,000
[junit4] 2> 1697406 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 20,200,000
[junit4] 2> 1697407 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 20,400,000
[junit4] 2> 1697407 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 20,600,000
[junit4] 2> 1697421 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 20,800,000
[junit4] 2> 1697421 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 21,000,000
[junit4] 2> 1697422 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 21,200,000
[junit4] 2> 1697422 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 21,400,000
[junit4] 2> 1697441 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 21,600,000
[junit4] 2> 1697444 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 21,800,000
[junit4] 2> 1697465 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 22,000,000
[junit4] 2> 1697469 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 22,200,000
[junit4] 2> 1697485 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 22,400,000
[junit4] 2> 1697501 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 22,600,000
[junit4] 2> 1697502 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 22,800,000
[junit4] 2> 1697502 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 23,000,000
[junit4] 2> 1697517 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 23,200,000
[junit4] 2> 1697532 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 23,400,000
[junit4] 2> 1697532 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 23,600,000
[junit4] 2> 1697532 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 23,800,000
[junit4] 2> 1697533 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 24,000,000
[junit4] 2> 1697550 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 24,200,000
[junit4] 2> 1697550 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 24,400,000
[junit4] 2> 1697551 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 24,600,000
[junit4] 2> 1697551 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 24,800,000
[junit4] 2> 1697566 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 25,000,000
[junit4] 2> 1697569 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 25,200,000
[junit4] 2> 1697569 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 25,400,000
[junit4] 2> 1697587 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 25,600,000
[junit4] 2> 1697610 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 25,800,000
[junit4] 2> 1697611 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 26,000,000
[junit4] 2> 1697611 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 26,200,000
[junit4] 2> 1697615 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 26,400,000
[junit4] 2> 1697631 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 26,600,000
[junit4] 2> 1697651 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 26,800,000
[junit4] 2> 1697664 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 27,000,000
[junit4] 2> 1697664 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 27,200,000
[junit4] 2> 1697680 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 27,400,000
[junit4] 2> 1697680 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 27,600,000
[junit4] 2> 1697681 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 27,800,000
[junit4] 2> 1697681 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 28,000,000
[junit4] 2> 1697681 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 28,200,000
[junit4] 2> 1697682 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 28,400,000
[junit4] 2> 1697682 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 28,600,000
[junit4] 2> 1697683 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 28,800,000
[junit4] 2> 1697683 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 29,000,000
[junit4] 2> 1697700 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 29,200,000
[junit4] 2> 1697701 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 29,400,000
[junit4] 2> 1697701 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 29,600,000
[junit4] 2> 1697701 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 29,800,000
[junit4] 2> 1697702 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 30,000,000
[junit4] 2> 1697702 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 30,200,000
[junit4] 2> 1697720 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 30,400,000
[junit4] 2> 1697740 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 30,600,000
[junit4] 2> 1697752 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 30,800,000
[junit4] 2> 1697753 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 31,000,000
[junit4] 2> 1697773 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 31,200,000
[junit4] 2> 1697825 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 31,400,000
[junit4] 2> 1697861 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 31,600,000
[junit4] 2> 1697914 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 31,800,000
[junit4] 2> 1697950 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 32,000,000
[junit4] 2> 1697987 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 32,200,000
[junit4] 2> 1698018 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 32,400,000
[junit4] 2> 1698018 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 32,600,000
[junit4] 2> 1698019 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 32,800,000
[junit4] 2> 1698019 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 33,000,000
[junit4] 2> 1698032 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 33,200,000
[junit4] 2> 1698032 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 33,400,000
[junit4] 2> 1698033 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 33,600,000
[junit4] 2> 1698033 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 33,800,000
[junit4] 2> 1698033 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 34,000,000
[junit4] 2> 1698034 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 34,200,000
[junit4] 2> 1698034 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 34,400,000
[junit4] 2> 1698035 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 34,600,000
[junit4] 2> 1698035 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 34,800,000
[junit4] 2> 1698035 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 35,000,000
[junit4] 2> 1698053 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 35,200,000
[junit4] 2> 1698054 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 35,400,000
[junit4] 2> 1698054 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 35,600,000
[junit4] 2> 1698055 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 35,800,000
[junit4] 2> 1698055 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 36,000,000
[junit4] 2> 1698055 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 36,200,000
[junit4] 2> 1698056 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 36,400,000
[junit4] 2> 1698076 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 36,600,000
[junit4] 2> 1698089 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 36,800,000
[junit4] 2> 1698089 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 37,000,000
[junit4] 2> 1698090 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 37,200,000
[junit4] 2> 1698090 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 37,400,000
[junit4] 2> 1698090 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 37,600,000
[junit4] 2> 1698091 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 37,800,000
[junit4] 2> 1698091 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 38,000,000
[junit4] 2> 1698092 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 38,200,000
[junit4] 2> 1698092 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 38,400,000
[junit4] 2> 1698096 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 38,600,000
[junit4] 2> 1698096 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 38,800,000
[junit4] 2> 1698117 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 39,000,000
[junit4] 2> 1698117 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 39,200,000
[junit4] 2> 1698118 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 39,400,000
[junit4] 2> 1698118 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 39,600,000
[junit4] 2> 1698118 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 39,800,000
[junit4] 2> 1698119 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 40,000,000
[junit4] 2> 1698121 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 40,200,000
[junit4] 2> 1698121 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 40,400,000
[junit4] 2> 1698121 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 40,600,000
[junit4] 2> 1698127 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 40,800,000
[junit4] 2> 1698128 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 41,000,000
[junit4] 2> 1698128 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 41,200,000
[junit4] 2> 1698128 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 41,400,000
[junit4] 2> 1698128 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 41,600,000
[junit4] 2> 1698129 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 41,800,000
[junit4] 2> 1698129 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 42,000,000
[junit4] 2> 1698130 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 42,200,000
[junit4] 2> 1698130 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 42,400,000
[junit4] 2> 1698130 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 42,600,000
[junit4] 2> 1698130 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 42,800,000
[junit4] 2> 1698131 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 43,000,000
[junit4] 2> 1698131 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 43,200,000
[junit4] 2> 1698131 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 43,400,000
[junit4] 2> 1698131 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 43,600,000
[junit4] 2> 1698132 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 43,800,000
[junit4] 2> 1698132 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 44,000,000
[junit4] 2> 1698132 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 44,200,000
[junit4] 2> 1698133 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 44,400,000
[junit4] 2> 1698167 DEBUG (ScheduledTrigger-3910-thread-2) [ ]
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"6d79e6700d240eTbhpqnket5jwln8eas0qgqr4ul",
[junit4] 2> "source":"scaleUpTrigger",
[junit4] 2> "eventTime":30814803090809870,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{
[junit4] 2>
"testScaleUp_collection_shard1_replica_n1":"docs=22300000, bytes=11150010240",
[junit4] 2>
"testScaleUp_collection_shard2_replica_n3":"docs=22300000, bytes=11150010240"},
[junit4] 2> "belowSize":{},
[junit4] 2> "requestedOps":[
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard1"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}},
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard2"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}}]}}
[junit4] 2> 1698168 DEBUG (ScheduledTrigger-3910-thread-2) [ ]
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas,
scaleUpTrigger, .scheduled_maintenance]
[junit4] 2> 1698168 DEBUG (ScheduledTrigger-3910-thread-2) [ ]
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
[junit4] 2> "id":"6d79e6700d240eTbhpqnket5jwln8eas0qgqr4ul",
[junit4] 2> "source":"scaleUpTrigger",
[junit4] 2> "eventTime":30814803090809870,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{
[junit4] 2>
"testScaleUp_collection_shard1_replica_n1":"docs=22300000, bytes=11150010240",
[junit4] 2>
"testScaleUp_collection_shard2_replica_n3":"docs=22300000, bytes=11150010240"},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":30814807367283570,
[junit4] 2> "requestedOps":[
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard1"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}},
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard2"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}}]}}
[junit4] 2> 1698169 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 44,600,000
[junit4] 2> 1698186 DEBUG (AutoscalingActionExecutor-3911-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"6d79e6700d240eTbhpqnket5jwln8eas0qgqr4ul",
[junit4] 2> "source":"scaleUpTrigger",
[junit4] 2> "eventTime":30814803090809870,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "aboveSize":{
[junit4] 2>
"testScaleUp_collection_shard1_replica_n1":"docs=22300000, bytes=11150010240",
[junit4] 2>
"testScaleUp_collection_shard2_replica_n3":"docs=22300000, bytes=11150010240"},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":30814807367283570,
[junit4] 2> "requestedOps":[
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard1"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}},
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard2"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}}]}}
[junit4] 2> 1698188 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 44,800,000
[junit4] 2> 1698194 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 45,000,000
[junit4] 2> 1698194 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 45,200,000
[junit4] 2> 1698194 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 45,400,000
[junit4] 2> 1698195 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 45,600,000
[junit4] 2> 1698195 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 45,800,000
[junit4] 2> 1698195 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 46,000,000
[junit4] 2> 1698195 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 46,200,000
[junit4] 2> 1698195 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 46,400,000
[junit4] 2> 1698196 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 46,600,000
[junit4] 2> 1698196 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 46,800,000
[junit4] 2> 1698196 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 47,000,000
[junit4] 2> 1698196 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 47,200,000
[junit4] 2> 1698201 DEBUG (AutoscalingActionExecutor-3911-thread-1) [ ]
o.a.s.c.a.ExecutePlanAction -- processing event: {
[junit4] 2> "id":"6d79e6700d240eTbhpqnket5jwln8eas0qgqr4ul",
[junit4] 2> "source":"scaleUpTrigger",
[junit4] 2> "eventTime":30814803090809870,
[junit4] 2> "eventType":"INDEXSIZE",
[junit4] 2> "properties":{
[junit4] 2> "__start__":2,
[junit4] 2> "aboveSize":{
[junit4] 2>
"testScaleUp_collection_shard1_replica_n1":"docs=22300000, bytes=11150010240",
[junit4] 2>
"testScaleUp_collection_shard2_replica_n3":"docs=22300000, bytes=11150010240"},
[junit4] 2> "belowSize":{},
[junit4] 2> "_enqueue_time_":30814807367283570,
[junit4] 2> "requestedOps":[
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard1"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}},
[junit4] 2> {
[junit4] 2> "action":"SPLITSHARD",
[junit4] 2> "hints":{
[junit4] 2> "COLL_SHARD":[{
[junit4] 2> "first":"testScaleUp_collection",
[junit4] 2> "second":"shard2"}],
[junit4] 2> "PARAMS":{"splitMethod":"link"}}}]}} with context
properties: {operations=[{
[junit4] 2>
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard",
[junit4] 2> "method":"GET",
[junit4] 2> "params.action":"SPLITSHARD",
[junit4] 2> "params.collection":"testScaleUp_collection",
[junit4] 2> "params.shard":"shard1",
[junit4] 2> "params.splitMethod":"link"}, {
[junit4] 2>
"class":"org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard",
[junit4] 2> "method":"GET",
[junit4] 2> "params.action":"SPLITSHARD",
[junit4] 2> "params.collection":"testScaleUp_collection",
[junit4] 2> "params.shard":"shard2",
[junit4] 2> "params.splitMethod":"link"}], AFTER_ACTION=[compute_plan],
BEFORE_ACTION=[compute_plan, execute_plan]}
[junit4] 2> 1698201 DEBUG (AutoscalingActionExecutor-3911-thread-1) [ ]
o.a.s.c.a.ExecutePlanAction Executing operation:
action=SPLITSHARD&collection=testScaleUp_collection&shard=shard1&splitMethod=link
[junit4] 2> 1698210 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 47,400,000
[junit4] 2> 1698210 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 47,600,000
[junit4] 2> 1698210 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 47,800,000
[junit4] 2> 1698230 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 48,000,000
[junit4] 2> 1698230 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 48,200,000
[junit4] 2> 1698231 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 48,400,000
[junit4] 2> 1698246 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 48,600,000
[junit4] 2> 1698267 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 48,800,000
[junit4] 2> 1698271 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 49,000,000
[junit4] 2> 1698271 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 49,200,000
[junit4] 2> 1698272 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 49,400,000
[junit4] 2> 1698272 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 49,600,000
[junit4] 2> 1698273 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 49,800,000
[junit4] 2> 1698273 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 50,000,000
[junit4] 2> 1698273 INFO
(TEST-TestSimExtremeIndexing.testScaleUp-seed#[57D72FFE59354B91]) [ ]
o.a.s.c.a.s.TestSimExtremeIndexing #### Total docs so far: 50,200,000
[junit4] 2> 1698283 INFO (TEST-TestSimExtremeIndexing.testScale
[...truncated too long message...]
17)
[junit4] > at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
[junit4] > at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:635)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException:
Timeout occured while waiting response from server at:
http://127.0.0.1:41403/y_yfm/collection2_shard5_replica_n23
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
[junit4] > at
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
[junit4] > at
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
[junit4] > at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:213)
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:561)
[junit4] > ... 6 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at
java.net.SocketInputStream.read(SocketInputStream.java:171)
[junit4] > at
java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
[junit4] > at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
[junit4] > at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] > at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] > at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] > at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] > at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] > at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] > at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] > at
org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] > at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
[junit4] > ... 12 moreThrowable #4:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught
exception in thread: Thread[id=146478, name=Thread-13483, state=RUNNABLE,
group=TGRP-FullSolrCloudDistribCmdsTest]
[junit4] > Caused by: java.lang.RuntimeException:
org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
[junit4] > at
__randomizedtesting.SeedInfo.seed([57D72FFE59354B91]:0)
[junit4] > at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:638)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting
response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:567)
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1019)
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
[junit4] > at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
[junit4] > at
org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:635)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException:
Timeout occured while waiting response from server at:
http://127.0.0.1:36956/y_yfm/collection2_shard4_replica_n17
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:661)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:256)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245)
[junit4] > at
org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
[junit4] > at
org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
[junit4] > at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:213)
[junit4] > at
org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:561)
[junit4] > ... 6 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at
java.net.SocketInputStream.read(SocketInputStream.java:171)
[junit4] > at
java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
[junit4] > at
org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
[junit4] > at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
[junit4] > at
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] > at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] > at
org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] > at
org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] > at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] > at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] > at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] > at
org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] > at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:549)
[junit4] > ... 12 more
[junit4] Completed [840/840 (5!)] on J0 in 7212.27s, 1 test, 5 errors <<<
FAILURES!
[...truncated 1 lines...]
[junit4] JVM J0: stdout was not empty, see:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-8.x/checkout/solr/build/solr-core/test/temp/junit4-J0-20190126_040023_1688651561050717430679.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-8.x/checkout/heapdumps/java_pid12085.hprof
...
[junit4] Heap dump file created [720089977 bytes in 17.656 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 8926 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-8.x/checkout/build.xml:661:
The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-8.x/checkout/build.xml:585:
Some of the tests produced a heap dump, but did not fail. Maybe a suppressed
OutOfMemoryError? Dumps created:
* java_pid12085.hprof
Total time: 588 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
