Build:
https://builds.apache.org/job/Lucene-Solr-BadApples-NightlyTests-master/38/
6 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D]:0)
FAILED: org.apache.solr.cloud.RestartWhileUpdatingTest.test
Error Message:
There are still nodes recoverying - waited for 320 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 320
seconds
at
__randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D:46ED9D9567070C75]:0)
at org.junit.Assert.fail(Assert.java:93)
at
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:920)
at
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1477)
at
org.apache.solr.cloud.RestartWhileUpdatingTest.test(RestartWhileUpdatingTest.java:145)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
at
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.RestartWhileUpdatingTest
Error Message:
7 threads leaked from SUITE scope at
org.apache.solr.cloud.RestartWhileUpdatingTest: 1) Thread[id=33118,
name=searcherExecutor-9607-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 2) Thread[id=33278,
name=searcherExecutor-9655-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 3) Thread[id=33313,
name=searcherExecutor-9669-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 4) Thread[id=33163,
name=searcherExecutor-9621-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 5) Thread[id=33039,
name=searcherExecutor-9579-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 6) Thread[id=33243,
name=searcherExecutor-9641-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 7) Thread[id=33081,
name=searcherExecutor-9593-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 7 threads leaked from SUITE
scope at org.apache.solr.cloud.RestartWhileUpdatingTest:
1) Thread[id=33118, name=searcherExecutor-9607-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=33278, name=searcherExecutor-9655-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=33313, name=searcherExecutor-9669-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=33163, name=searcherExecutor-9621-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=33039, name=searcherExecutor-9579-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=33243, name=searcherExecutor-9641-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=33081, name=searcherExecutor-9593-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D]:0)
FAILED:
junit.framework.TestSuite.org.apache.solr.cloud.RestartWhileUpdatingTest
Error Message:
There are still zombie threads that couldn't be terminated: 1)
Thread[id=33118, name=searcherExecutor-9607-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 2) Thread[id=33278,
name=searcherExecutor-9655-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 3) Thread[id=33313,
name=searcherExecutor-9669-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 4) Thread[id=33163,
name=searcherExecutor-9621-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 5) Thread[id=33039,
name=searcherExecutor-9579-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 6) Thread[id=33243,
name=searcherExecutor-9641-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 7) Thread[id=33081,
name=searcherExecutor-9593-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest] at sun.misc.Unsafe.park(Native
Method) at
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
threads that couldn't be terminated:
1) Thread[id=33118, name=searcherExecutor-9607-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=33278, name=searcherExecutor-9655-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=33313, name=searcherExecutor-9669-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=33163, name=searcherExecutor-9621-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=33039, name=searcherExecutor-9579-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=33243, name=searcherExecutor-9641-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=33081, name=searcherExecutor-9593-thread-1, state=WAITING,
group=TGRP-RestartWhileUpdatingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D]:0)
FAILED:
org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
Error Message:
missing cleanup event: [CapturedEvent{timestamp=4155131369024193,
stage=STARTED, actionName='null', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance", "eventTime":4155131355456950,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131381776512,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance", "eventTime":4155131355456950,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131393906459, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance", "eventTime":4155131355456950,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance,
properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542847548372883183,
currentTimeNs=1543020348428579401, deltaSec=172800, ttlSec=20}}},
properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131396981068, stage=SUCCEEDED,
actionName='null', event={ "id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance", "eventTime":4155131355456950,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136428113326, stage=STARTED,
actionName='null', event={ "id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance", "eventTime":4155136404524971,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136429177945,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance", "eventTime":4155136404524971,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136433655170, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance", "eventTime":4155136404524971,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136435222540, stage=SUCCEEDED,
actionName='null', event={ "id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance", "eventTime":4155136404524971,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141437468251, stage=STARTED,
actionName='null', event={ "id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance", "eventTime":4155141436124705,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141438336518,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance", "eventTime":4155141436124705,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141441929852, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance", "eventTime":4155141436124705,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141443699633, stage=SUCCEEDED,
actionName='null', event={ "id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance", "eventTime":4155141436124705,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146445298229, stage=STARTED,
actionName='null', event={ "id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance", "eventTime":4155146444361708,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146446088538,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance", "eventTime":4155146444361708,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146449394561, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance", "eventTime":4155146444361708,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146451212783, stage=SUCCEEDED,
actionName='null', event={ "id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance", "eventTime":4155146444361708,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151452690011, stage=STARTED,
actionName='null', event={ "id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance", "eventTime":4155151451781251,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151453557189,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance", "eventTime":4155151451781251,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151456492907, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance", "eventTime":4155151451781251,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151458017436, stage=SUCCEEDED,
actionName='null', event={ "id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance", "eventTime":4155151451781251,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156459769752, stage=STARTED,
actionName='null', event={ "id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance", "eventTime":4155156458723467,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}}, context={}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156460824188,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance", "eventTime":4155156458723467,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={ "trigger":".scheduled_maintenance",
"stage":[ "STARTED", "ABORTED", "SUCCEEDED", "FAILED"],
"beforeAction":"inactive_shard_plan", "afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156463086043, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance", "eventTime":4155156458723467,
"eventType":"SCHEDULED", "properties":{ "actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance,
properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/shard1-splitting={stateTimestamp=1543020348427050388,
currentTimeNs=1543020373503288416, deltaSec=25, ttlSec=20}}},
properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
"trigger":".scheduled_maintenance", "stage":[ "STARTED", "ABORTED",
"SUCCEEDED", "FAILED"], "beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}]
Stack Trace:
java.lang.AssertionError: missing cleanup event:
[CapturedEvent{timestamp=4155131369024193, stage=STARTED, actionName='null',
event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance",
"eventTime":4155131355456950,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131381776512,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance",
"eventTime":4155131355456950,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131393906459, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance",
"eventTime":4155131355456950,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance,
properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542847548372883183,
currentTimeNs=1543020348428579401, deltaSec=172800, ttlSec=20}}},
properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155131396981068, stage=SUCCEEDED,
actionName='null', event={
"id":"ec311e86fe5b6T15fvpvpm9qwad3ho51dkk46rp",
"source":".scheduled_maintenance",
"eventTime":4155131355456950,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020348395,
"_enqueue_time_":4155131366322050}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136428113326, stage=STARTED,
actionName='null', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance",
"eventTime":4155136404524971,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136429177945,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance",
"eventTime":4155136404524971,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136433655170, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance",
"eventTime":4155136404524971,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155136435222540, stage=SUCCEEDED,
actionName='null', event={
"id":"ec31315628fabT15fvpvpm9qwad3ho51dkk46rv",
"source":".scheduled_maintenance",
"eventTime":4155136404524971,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020353445,
"_enqueue_time_":4155136404806405}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141437468251, stage=STARTED,
actionName='null', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance",
"eventTime":4155141436124705,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141438336518,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance",
"eventTime":4155141436124705,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141441929852, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance",
"eventTime":4155141436124705,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155141443699633, stage=SUCCEEDED,
actionName='null', event={
"id":"ec314414aae21T15fvpvpm9qwad3ho51dkk46rw",
"source":".scheduled_maintenance",
"eventTime":4155141436124705,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020358477,
"_enqueue_time_":4155141436360514}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146445298229, stage=STARTED,
actionName='null', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance",
"eventTime":4155146444361708,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146446088538,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance",
"eventTime":4155146444361708,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146449394561, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance",
"eventTime":4155146444361708,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155146451212783, stage=SUCCEEDED,
actionName='null', event={
"id":"ec3156bce4fecT15fvpvpm9qwad3ho51dkk46rx",
"source":".scheduled_maintenance",
"eventTime":4155146444361708,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020363485,
"_enqueue_time_":4155146444593128}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151452690011, stage=STARTED,
actionName='null', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance",
"eventTime":4155151451781251,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151453557189,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance",
"eventTime":4155151451781251,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151456492907, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance",
"eventTime":4155151451781251,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan,
execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155151458017436, stage=SUCCEEDED,
actionName='null', event={
"id":"ec31696457883T15fvpvpm9qwad3ho51dkk46ry",
"source":".scheduled_maintenance",
"eventTime":4155151451781251,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020368492,
"_enqueue_time_":4155151452039333}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156459769752, stage=STARTED,
actionName='null', event={
"id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance",
"eventTime":4155156458723467,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}}, context={}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156460824188,
stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
"id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance",
"eventTime":4155156458723467,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}, CapturedEvent{timestamp=4155156463086043, stage=AFTER_ACTION,
actionName='inactive_shard_plan', event={
"id":"ec317c0b5588bT15fvpvpm9qwad3ho51dkk46rz",
"source":".scheduled_maintenance",
"eventTime":4155156458723467,
"eventType":"SCHEDULED",
"properties":{
"actualEventTime":1543020373499,
"_enqueue_time_":4155156459003317}},
context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test],
source=.scheduled_maintenance,
properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/shard1-splitting={stateTimestamp=1543020348427050388,
currentTimeNs=1543020373503288416, deltaSec=25, ttlSec=20}}},
properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
"trigger":".scheduled_maintenance",
"stage":[
"STARTED",
"ABORTED",
"SUCCEEDED",
"FAILED"],
"beforeAction":"inactive_shard_plan",
"afterAction":"inactive_shard_plan",
"class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"},
message='null'}]
at
__randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D:D395623DA8B84686]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at
org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:253)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13286 lines...]
[junit4] Suite:
org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest
[junit4] 2> 399963 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_CEB9A24FC9FB618D-001/init-core-data-001
[junit4] 2> 399965 WARN
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 399965 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 399967 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via:
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 399968 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_CEB9A24FC9FB618D-001/tempDir-001
[junit4] 2> 399968 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 399969 INFO (Thread-843) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 399969 INFO (Thread-843) [ ] o.a.s.c.ZkTestServer Starting
server
[junit4] 2> 399972 ERROR (Thread-843) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 400069 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.c.ZkTestServer start zk server on port:37399
[junit4] 2> 400072 INFO (zkConnectionManagerCallback-823-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400080 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git:
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
[junit4] 2> 400081 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 400081 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 400081 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 400082 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@4fad4e15{/solr,null,AVAILABLE}
[junit4] 2> 400089 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@63af7ebf{SSL,[ssl,
http/1.1]}{127.0.0.1:45198}
[junit4] 2> 400089 INFO (jetty-launcher-820-thread-1) [ ]
o.e.j.s.Server Started @400220ms
[junit4] 2> 400089 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=45198}
[junit4] 2> 400090 ERROR (jetty-launcher-820-thread-1) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 400090 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 400090 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
8.0.0
[junit4] 2> 400090 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 400090 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 400090 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-11-24T00:45:45.209Z
[junit4] 2> 400092 INFO (zkConnectionManagerCallback-825-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400093 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 400237 INFO (jetty-launcher-820-thread-1) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37399/solr
[junit4] 2> 400239 INFO (zkConnectionManagerCallback-829-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400247 INFO (zkConnectionManagerCallback-831-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400390 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:45198_solr
[junit4] 2> 400391 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.c.Overseer Overseer
(id=72329904509681667-127.0.0.1:45198_solr-n_0000000000) starting
[junit4] 2> 400404 INFO (zkConnectionManagerCallback-838-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400407 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster
at 127.0.0.1:37399/solr ready
[junit4] 2> 400408 INFO
(OverseerStateUpdate-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[n:127.0.0.1:45198_solr ] o.a.s.c.Overseer Starting to work on the main
queue : 127.0.0.1:45198_solr
[junit4] 2> 400409 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:45198_solr
[junit4] 2> 400411 INFO
(OverseerStateUpdate-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[n:127.0.0.1:45198_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 400418 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and
.scheduled_maintenance triggers
[junit4] 2> 400419 INFO (zkCallback-837-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 400420 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode
version 1
[junit4] 2> 400421 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1,
lastZnodeVersion -1
[junit4] 2> 400421 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto
znodeVersion 1
[junit4] 2> 400427 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial
livenodes: [127.0.0.1:45198_solr]
[junit4] 2> 400428 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 400428 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1,
lastZnodeVersion 1
[junit4] 2> 400428 DEBUG (ScheduledTrigger-1831-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 1
[junit4] 2> 400455 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.h.a.MetricsHistoryHandler No .system
collection, keeping metrics history in memory.
[junit4] 2> 400497 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_45198.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@10f64c55
[junit4] 2> 400508 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_45198.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@10f64c55
[junit4] 2> 400509 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_45198.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@10f64c55
[junit4] 2> 400510 INFO (jetty-launcher-820-thread-1)
[n:127.0.0.1:45198_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_CEB9A24FC9FB618D-001/tempDir-001/node1/.
[junit4] 2> 400535 INFO (zkConnectionManagerCallback-841-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400540 INFO (zkConnectionManagerCallback-846-thread-1) [ ]
o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400542 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 400543 INFO
(SUITE-ScheduledMaintenanceTriggerTest-seed#[CEB9A24FC9FB618D]-worker) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37399/solr ready
[junit4] 2> 400561 INFO
(TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[CEB9A24FC9FB618D])
[ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerDefaults
[junit4] 2> 400563 INFO
(TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[CEB9A24FC9FB618D])
[ ] o.a.s.c.a.ScheduledMaintenanceTriggerTest {
[junit4] 2> "triggers":{
[junit4] 2> ".auto_add_replicas":{
[junit4] 2> "name":".auto_add_replicas",
[junit4] 2> "event":"nodeLost",
[junit4] 2> "waitFor":120,
[junit4] 2> "enabled":true,
[junit4] 2> "actions":[
[junit4] 2> {
[junit4] 2> "name":"auto_add_replicas_plan",
[junit4] 2> "class":"solr.AutoAddReplicasPlanAction"},
[junit4] 2> {
[junit4] 2> "name":"execute_plan",
[junit4] 2> "class":"solr.ExecutePlanAction"}]},
[junit4] 2> ".scheduled_maintenance":{
[junit4] 2> "name":".scheduled_maintenance",
[junit4] 2> "event":"scheduled",
[junit4] 2> "startTime":"NOW",
[junit4] 2> "every":"+1DAY",
[junit4] 2> "enabled":true,
[junit4] 2> "actions":[
[junit4] 2> {
[junit4] 2> "name":"inactive_shard_plan",
[junit4] 2> "class":"solr.InactiveShardPlanAction"},
[junit4] 2> {
[junit4] 2> "name":"execute_plan",
[junit4] 2> "class":"solr.ExecutePlanAction"}]}},
[junit4] 2> "listeners":{
[junit4] 2> ".auto_add_replicas.system":{
[junit4] 2> "beforeAction":[],
[junit4] 2> "afterAction":[],
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED",
[junit4] 2> "BEFORE_ACTION",
[junit4] 2> "AFTER_ACTION",
[junit4] 2> "IGNORED"],
[junit4] 2> "trigger":".auto_add_replicas",
[junit4] 2>
"class":"org.apache.solr.cloud.autoscaling.SystemLogListener"},
[junit4] 2> ".scheduled_maintenance.system":{
[junit4] 2> "beforeAction":[],
[junit4] 2> "afterAction":[],
[junit4] 2> "stage":[
[junit4] 2> "STARTED",
[junit4] 2> "ABORTED",
[junit4] 2> "SUCCEEDED",
[junit4] 2> "FAILED",
[junit4] 2> "BEFORE_ACTION",
[junit4] 2> "AFTER_ACTION",
[junit4] 2> "IGNORED"],
[junit4] 2> "trigger":".scheduled_maintenance",
[junit4] 2>
"class":"org.apache.solr.cloud.autoscaling.SystemLogListener"}},
[junit4] 2> "properties":{}}
[junit4] 2> 400603 INFO (qtp1655601053-3648) [n:127.0.0.1:45198_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 400604 DEBUG (qtp1655601053-3645) [n:127.0.0.1:45198_solr ]
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 400605 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling
params={wt=javabin&version=2} status=0 QTime=12
[junit4] 2> 400605 DEBUG (zkCallback-837-thread-1) [ ]
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version
2
[junit4] 2> 400609 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto
znodeVersion 2
[junit4] 2> 400610 INFO
(TEST-ScheduledMaintenanceTriggerTest.testTriggerDefaults-seed#[CEB9A24FC9FB618D])
[ ] o.a.s.SolrTestCaseJ4 ###Ending testTriggerDefaults
[junit4] 2> 400614 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 400614 DEBUG
(OverseerAutoScalingTriggerThread-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2,
lastZnodeVersion 2
[junit4] 2> 400637 INFO
(TEST-ScheduledMaintenanceTriggerTest.testInactiveShardCleanup-seed#[CEB9A24FC9FB618D])
[ ] o.a.s.SolrTestCaseJ4 ###Starting testInactiveShardCleanup
[junit4] 2> 400638 INFO (qtp1655601053-3647) [n:127.0.0.1:45198_solr ]
o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params
collection.configName=conf&name=ScheduledMaintenanceTriggerTest_collection1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2
and sendToOCPQueue=true
[junit4] 2> 400642 INFO
(OverseerThreadFactory-1833-thread-1-processing-n:127.0.0.1:45198_solr)
[n:127.0.0.1:45198_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection
ScheduledMaintenanceTriggerTest_collection1
[junit4] 2> 400759 INFO (qtp1655601053-3646) [n:127.0.0.1:45198_solr ]
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 400766 INFO
(OverseerStateUpdate-72329904509681667-127.0.0.1:45198_solr-n_0000000000)
[n:127.0.0.1:45198_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"ScheduledMaintenanceTriggerTest_collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2>
"core":"ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45198/solr";,
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 400972 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.h.a.CoreAdminOperation core create command
qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=ScheduledMaintenanceTriggerTest_collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 400973 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 401430 DEBUG (ScheduledTrigger-1831-thread-3) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 1
[junit4] 2> 401993 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 402002 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.s.IndexSchema
[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] Schema
name=minimal
[junit4] 2> 402005 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 402005 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.CoreContainer Creating SolrCore
'ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1' using
configuration from collection ScheduledMaintenanceTriggerTest_collection1,
trusted=true
[junit4] 2> 402008 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_45198.solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1'
(registry
'solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1')
enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@10f64c55
[junit4] 2> 402008 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.SolrCore
[[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] ] Opening new
SolrCore at
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_CEB9A24FC9FB618D-001/tempDir-001/node1/ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1],
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_CEB9A24FC9FB618D-001/tempDir-001/node1/./ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1/data/]
[junit4] 2> 402085 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.u.UpdateHandler Using UpdateLog implementation:
org.apache.solr.update.UpdateLog
[junit4] 2> 402085 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 402087 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 402087 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 402090 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.s.SolrIndexSearcher Opening
[Searcher@56544786[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
main]
[junit4] 2> 402092 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase:
/configs/conf
[junit4] 2> 402093 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using
ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 402094 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 402096 INFO
(searcherExecutor-1838-thread-1-processing-n:127.0.0.1:45198_solr
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2)
[n:127.0.0.1:45198_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1
r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.SolrCore
[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] Registered new
searcher
Searcher@56544786[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 402096 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using
new clock 1617974103601315840
[junit4] 2> 402113 INFO (qtp1655601053-3645) [n:127.0.0.1:45198_solr
c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2
x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1]
o.a.s.c.ZkShardTerms Successful update of terms at
/collections/ScheduledMaintenanceTriggerTest_collection1/terms/shard1 t
[...truncated too long message...]
tingsFormat(name=LuceneFixedGap), 48parent_f2_s=BlockTreeOrds(blocksize=128),
7grand1_s=PostingsFormat(name=LuceneFixedGap),
15parent_f2_s=BlockTreeOrds(blocksize=128),
25parent_f2_s=PostingsFormat(name=MockRandom),
6parent_f2_s=BlockTreeOrds(blocksize=128), 35parent_f2_s=FST50,
0parent_f2_s=FST50, 3grand1_s=PostingsFormat(name=LuceneFixedGap),
4parent_f1_s=PostingsFormat(name=LuceneFixedGap),
19parent_f1_s=PostingsFormat(name=LuceneFixedGap),
9parent_f2_s=PostingsFormat(name=LuceneFixedGap),
a_t=PostingsFormat(name=MockRandom), id=FST50,
5grand3_s=PostingsFormat(name=LuceneFixedGap),
1parent_f1_s=BlockTreeOrds(blocksize=128),
13parent_f1_s=PostingsFormat(name=MockRandom), 23parent_f1_s=FST50,
_root_=PostingsFormat(name=MockRandom),
43parent_f1_s=BlockTreeOrds(blocksize=128), 49parent_f1_s=FST50,
29parent_f1_s=FST50, 33parent_f1_s=PostingsFormat(name=LuceneFixedGap),
39parent_f1_s=PostingsFormat(name=MockRandom),
3child0_s=BlockTreeOrds(blocksize=128), 4child3_s=BlockTreeOrds(blocksize=128),
12parent_f1_s=FST50, 22parent_f1_s=PostingsFormat(name=LuceneFixedGap),
1grand0_s=BlockTreeOrds(blocksize=128),
45parent_f2_s=PostingsFormat(name=LuceneFixedGap), 7parent_f1_s=FST50,
2child1_s=FST50, 3parent_f2_s=PostingsFormat(name=MockRandom),
32parent_f1_s=BlockTreeOrds(blocksize=128),
42parent_f1_s=PostingsFormat(name=MockRandom),
6grand3_s=BlockTreeOrds(blocksize=128), 31parent_f2_s=FST50,
41parent_f2_s=PostingsFormat(name=LuceneFixedGap),
5grand2_s=BlockTreeOrds(blocksize=128), 4grand1_s=BlockTreeOrds(blocksize=128),
11parent_f2_s=BlockTreeOrds(blocksize=128),
21parent_f2_s=PostingsFormat(name=MockRandom),
51parent_f2_s=BlockTreeOrds(blocksize=128),
7grand4_s=BlockTreeOrds(blocksize=128), 3grand0_s=BlockTreeOrds(blocksize=128),
40parent_f1_s=PostingsFormat(name=LuceneFixedGap),
9parent_f1_s=BlockTreeOrds(blocksize=128),
50parent_f1_s=BlockTreeOrds(blocksize=128), 30parent_f1_s=FST50,
14parent_f2_s=PostingsFormat(name=MockRandom),
20parent_f1_s=PostingsFormat(name=MockRandom),
1parent_f2_s=PostingsFormat(name=LuceneFixedGap),
7grand0_s=BlockTreeOrds(blocksize=128), text_t=PostingsFormat(name=MockRandom),
24parent_f2_s=FST50, 44parent_f2_s=BlockTreeOrds(blocksize=128),
34parent_f2_s=PostingsFormat(name=LuceneFixedGap), 13parent_f2_s=FST50,
type_s=PostingsFormat(name=MockRandom),
23parent_f2_s=PostingsFormat(name=LuceneFixedGap),
43parent_f2_s=PostingsFormat(name=MockRandom),
10parent_f1_s=BlockTreeOrds(blocksize=128),
33parent_f2_s=BlockTreeOrds(blocksize=128),
22parent_f2_s=BlockTreeOrds(blocksize=128),
4child0_s=PostingsFormat(name=LuceneFixedGap),
12parent_f2_s=PostingsFormat(name=LuceneFixedGap), 42parent_f2_s=FST50,
32parent_f2_s=PostingsFormat(name=MockRandom),
31parent_f1_s=PostingsFormat(name=MockRandom),
5grand1_s=PostingsFormat(name=MockRandom),
6grand4_s=PostingsFormat(name=MockRandom),
11parent_f1_s=PostingsFormat(name=LuceneFixedGap),
51parent_f1_s=PostingsFormat(name=LuceneFixedGap),
4grand2_s=PostingsFormat(name=MockRandom),
21parent_f1_s=BlockTreeOrds(blocksize=128),
7grand3_s=PostingsFormat(name=MockRandom), 41parent_f1_s=FST50,
37parent_f1_s=PostingsFormat(name=LuceneFixedGap),
40parent_f2_s=BlockTreeOrds(blocksize=128),
50parent_f2_s=PostingsFormat(name=MockRandom),
47parent_f1_s=BlockTreeOrds(blocksize=128),
14parent_f1_s=BlockTreeOrds(blocksize=128), 20parent_f2_s=FST50,
34parent_f1_s=FST50, 24parent_f1_s=PostingsFormat(name=MockRandom),
44parent_f1_s=PostingsFormat(name=LuceneFixedGap),
30parent_f2_s=PostingsFormat(name=LuceneFixedGap),
5parent_f1_s=BlockTreeOrds(blocksize=128),
6grand0_s=PostingsFormat(name=MockRandom), 46parent_f2_s=FST50,
10parent_f2_s=PostingsFormat(name=MockRandom),
8parent_f1_s=PostingsFormat(name=LuceneFixedGap),
27parent_f2_s=PostingsFormat(name=LuceneFixedGap),
2parent_f2_s=BlockTreeOrds(blocksize=128), 4child1_s=FST50,
2grand1_s=BlockTreeOrds(blocksize=128),
17parent_f2_s=BlockTreeOrds(blocksize=128), 3child2_s=FST50,
16parent_f2_s=PostingsFormat(name=LuceneFixedGap),
26parent_f2_s=BlockTreeOrds(blocksize=128), 1child0_s=FST50,
36parent_f2_s=PostingsFormat(name=MockRandom), 7grand6_s=FST50,
5grand0_s=FST50, 18parent_f1_s=FST50,
28parent_f1_s=PostingsFormat(name=MockRandom), 6grand5_s=FST50,
7grand2_s=FST50, 48parent_f1_s=PostingsFormat(name=LuceneFixedGap),
4grand3_s=FST50, 15parent_f1_s=PostingsFormat(name=LuceneFixedGap),
6parent_f1_s=PostingsFormat(name=MockRandom),
25parent_f1_s=BlockTreeOrds(blocksize=128),
0parent_f1_s=PostingsFormat(name=LuceneFixedGap), 3grand2_s=FST50,
35parent_f1_s=PostingsFormat(name=MockRandom), 4parent_f2_s=FST50,
19parent_f2_s=FST50, 37parent_f2_s=BlockTreeOrds(blocksize=128),
47parent_f2_s=PostingsFormat(name=MockRandom), 5grand4_s=FST50,
38parent_f1_s=FST50, 6grand1_s=FST50,
5parent_f2_s=PostingsFormat(name=LuceneFixedGap),
46parent_f1_s=PostingsFormat(name=MockRandom),
16parent_f1_s=BlockTreeOrds(blocksize=128), 8parent_f2_s=FST50,
39parent_f2_s=FST50, 29parent_f2_s=PostingsFormat(name=MockRandom),
2parent_f1_s=PostingsFormat(name=MockRandom),
4child2_s=PostingsFormat(name=MockRandom), rnd_b=FST50, 27parent_f1_s=FST50,
45parent_f1_s=FST50, 17parent_f1_s=PostingsFormat(name=MockRandom),
2grand0_s=PostingsFormat(name=MockRandom),
49parent_f2_s=PostingsFormat(name=LuceneFixedGap),
3child1_s=PostingsFormat(name=LuceneFixedGap),
7parent_f2_s=PostingsFormat(name=MockRandom),
26parent_f1_s=PostingsFormat(name=LuceneFixedGap),
2child0_s=PostingsFormat(name=MockRandom), 3parent_f1_s=FST50,
36parent_f1_s=BlockTreeOrds(blocksize=128)},
docValues:{_version_=DocValuesFormat(name=Lucene70),
id=DocValuesFormat(name=Direct), text_t=DocValuesFormat(name=Lucene70)},
maxPointsInLeafNode=1501, maxMBSortInHeap=6.502434168932453,
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@292d9fcf),
locale=et-EE, timezone=Asia/Ashgabat
[junit4] 2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation
1.8.0_191 (64-bit)/cpus=4,threads=50,free=147013240,total=489684992
[junit4] 2> NOTE: All tests run in this JVM: [BitVectorTest,
ConjunctionSolrSpellCheckerTest, TestPseudoReturnFields, TestReqParamsAPI,
TestTlogReplica, CustomHighlightComponentTest, TestHighlightDedupGrouping,
SaslZkACLProviderTest, TestLockTree, VMParamsZkACLAndCredentialsProvidersTest,
TestManagedSynonymGraphFilterFactory, RegexBoostProcessorTest,
TestCorePropertiesReload, SolrSlf4jReporterTest, LeaderTragicEventTest,
UpdateLogTest, TestRecovery, HdfsNNFailoverTest,
DistributedSuggestComponentTest, MBeansHandlerTest, TestQuerySenderListener,
TestFieldTypeResource, GraphQueryTest, TestNonDefinedSimilarityFactory,
TestChildDocTransformer, BlockJoinFacetDistribTest, FastVectorHighlighterTest,
ScheduledMaintenanceTriggerTest, DistributedQueryComponentOptimizationTest,
TestXmlQParser, TestSweetSpotSimilarityFactory, TestNamedUpdateProcessors,
TestNestedUpdateProcessor, TestRequestForwarding, MetricsConfigTest,
TestSurroundQueryParser, PeerSyncWithIndexFingerprintCachingTest,
CdcrBidirectionalTest, HdfsBasicDistributedZkTest, ZkFailoverTest,
TestInPlaceUpdatesDistrib, ConnectionReuseTest, TaggerTest,
MoreLikeThisHandlerTest, ResponseBuilderTest, TestUniqueKeyFieldResource,
RequestHandlersTest, CreateCollectionCleanupTest, TestSortByMinMaxFunction,
TestRandomFlRTGCloud, DistributedFacetPivotLongTailTest,
SuggestComponentContextFilterQueryTest, NodeLostTriggerTest, TestSolrXml,
TestExpandComponent, DocumentAnalysisRequestHandlerTest,
IgnoreLargeDocumentProcessorFactoryTest, TestComplexPhraseLeadingWildcard,
TolerantUpdateProcessorTest, TestFieldCollectionResource,
TestUseDocValuesAsStored, UniqFieldsUpdateProcessorFactoryTest,
SolrGraphiteReporterTest, CdcrWithNodesRestartsTest, TermVectorComponentTest,
TestMacros, TestNumericTerms32, ExecutePlanActionTest, SolrIndexMetricsTest,
TestFieldCacheVsDocValues, TestPrepRecovery, FullSolrCloudDistribCmdsTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running
'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=CEB9A24FC9FB618D
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true
-Dtests.badapples=true
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/test-data/enwiki.random.lines.txt
-Dtests.locale=et-EE -Dtests.timezone=Asia/Ashgabat -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | FullSolrCloudDistribCmdsTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>=
7200000 msec).
[junit4] > at
__randomizedtesting.SeedInfo.seed([CEB9A24FC9FB618D]:0)
[junit4] Completed [773/836 (3!)] on J1 in 7284.17s, 1 test, 2 errors <<<
FAILURES!
[...truncated 187 lines...]
[junit4] JVM J1: stdout was not empty, see:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/solr/build/solr-core/test/temp/junit4-J1-20181124_003904_8947999495343273867036.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/heapdumps/java_pid8616.hprof
...
[junit4] Heap dump file created [614911825 bytes in 3.881 secs]
[junit4] <<< JVM J1: EOF ----
[...truncated 8869 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/build.xml:661:
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-NightlyTests-master/checkout/build.xml:585:
Some of the tests produced a heap dump, but did not fail. Maybe a suppressed
OutOfMemoryError? Dumps created:
* java_pid8616.hprof
Total time: 418 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
