Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/109/
8 tests failed. FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=113565, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=113565, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42684/uxa, http://127.0.0.1:41289/uxa, http://127.0.0.1:53094/uxa, http://127.0.0.1:55817/uxa, http://127.0.0.1:41111/uxa] at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997) Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:42684/uxa, http://127.0.0.1:41289/uxa, http://127.0.0.1:53094/uxa, http://127.0.0.1:55817/uxa, http://127.0.0.1:41111/uxa] at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:383) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1228) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:998) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:934) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987) Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55817/uxa: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr- at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:403) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:356) ... 7 more FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestConfigSetsAPIZkFailure Error Message: ObjectTracker found 522 object(s) that were not released!!! [NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrZkClient, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrZkClient, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor] Stack Trace: java.lang.AssertionError: ObjectTracker found 522 object(s) that were not released!!! [NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrZkClient, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, SolrZkClient, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, SolrCore, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, SolrZkClient, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, SolrCore, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, SolrCore, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, SolrCore, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, SolrCore, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, MDCAwareThreadPoolExecutor, NRTCachingDirectory, NRTCachingDirectory, MDCAwareThreadPoolExecutor] at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:257) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestConfigSetsAPIZkFailure Error Message: 7 threads leaked from SUITE scope at org.apache.solr.cloud.TestConfigSetsAPIZkFailure: 1) Thread[id=105042, name=qtp1117026265-105042, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=105024, name=IPC Client (1885185032) connection to localhost/127.0.0.1:41516 from jenkins, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.FilterInputStream.read(FilterInputStream.java:133) at java.io.FilterInputStream.read(FilterInputStream.java:133) at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:520) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read(BufferedInputStream.java:265) at java.io.DataInputStream.readInt(DataInputStream.java:387) at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1084) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:979) 3) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=105044, name=qtp1346551373-105044, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=105045, name=qtp288419314-105045, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=105043, name=qtp1887659905-105043, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=105041, name=qtp1813203947-105041, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 7 threads leaked from SUITE scope at org.apache.solr.cloud.TestConfigSetsAPIZkFailure: 1) Thread[id=105042, name=qtp1117026265-105042, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=105024, name=IPC Client (1885185032) connection to localhost/127.0.0.1:41516 from jenkins, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) at java.io.FilterInputStream.read(FilterInputStream.java:133) at java.io.FilterInputStream.read(FilterInputStream.java:133) at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:520) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read(BufferedInputStream.java:265) at java.io.DataInputStream.readInt(DataInputStream.java:387) at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1084) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:979) 3) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=105044, name=qtp1346551373-105044, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=105045, name=qtp288419314-105045, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=105043, name=qtp1887659905-105043, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=105041, name=qtp1813203947-105041, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestConfigSetsAPIZkFailure Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: 1) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.rule.RuleEngineTest Error Message: Stack Trace: java.lang.AssertionError at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.before(TestRuleTemporaryFilesCleanup.java:112) at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.before(TestRuleAdapter.java:26) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:35) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.rule.RuleEngineTest Error Message: 5 threads leaked from SUITE scope at org.apache.solr.cloud.rule.RuleEngineTest: 1) Thread[id=104956, name=qtp1887659905-104956, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=104958, name=qtp1346551373-104958, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=104957, name=qtp1117026265-104957, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=104954, name=qtp1813203947-104954, state=TERMINATED, group={null group}] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=104955, name=qtp288419314-104955, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.rule.RuleEngineTest: 1) Thread[id=104956, name=qtp1887659905-104956, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=104958, name=qtp1346551373-104958, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=104957, name=qtp1117026265-104957, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=104954, name=qtp1813203947-104954, state=TERMINATED, group={null group}] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=104955, name=qtp288419314-104955, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) at java.lang.Thread.run(Thread.java:745) at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload Error Message: expected:<[{indexVersion=1467553637038,generation=2,filelist=[_13y.cfe, _13y.cfs, _13y.si, _141.cfe, _141.cfs, _141.si, _143.cfe, _143.cfs, _143.si, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_2]}]> but was:<[{indexVersion=1467553637038,generation=2,filelist=[_13y.cfe, _13y.cfs, _13y.si, _141.cfe, _141.cfs, _141.si, _143.cfe, _143.cfs, _143.si, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_2]}, {indexVersion=1467553637038,generation=3,filelist=[_144.fdt, _144.fdx, _144.fnm, _144.nvd, _144.nvm, _144.si, _144_BlockTreeOrds_0.doc, _144_BlockTreeOrds_0.tio, _144_BlockTreeOrds_0.tipo, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_3]}]> Stack Trace: java.lang.AssertionError: expected:<[{indexVersion=1467553637038,generation=2,filelist=[_13y.cfe, _13y.cfs, _13y.si, _141.cfe, _141.cfs, _141.si, _143.cfe, _143.cfs, _143.si, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_2]}]> but was:<[{indexVersion=1467553637038,generation=2,filelist=[_13y.cfe, _13y.cfs, _13y.si, _141.cfe, _141.cfs, _141.si, _143.cfe, _143.cfs, _143.si, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_2]}, {indexVersion=1467553637038,generation=3,filelist=[_144.fdt, _144.fdx, _144.fnm, _144.nvd, _144.nvm, _144.si, _144_BlockTreeOrds_0.doc, _144_BlockTreeOrds_0.tio, _144_BlockTreeOrds_0.tipo, _146.cfe, _146.cfs, _146.si, _148.fdt, _148.fdx, _148.fnm, _148.nvd, _148.nvm, _148.si, _148_BlockTreeOrds_0.doc, _148_BlockTreeOrds_0.tio, _148_BlockTreeOrds_0.tipo, _149.cfe, _149.cfs, _149.si, _14a.cfe, _14a.cfs, _14a.si, segments_3]}]> at __randomizedtesting.SeedInfo.seed([4554E57032493FF7:6083FE40420131F4]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1227) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.response.TestGeoJSONResponseWriter Error Message: Stack Trace: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) at org.apache.lucene.util.TestRuleRestoreSystemProperties.before(TestRuleRestoreSystemProperties.java:52) at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.before(TestRuleAdapter.java:26) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:35) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 12003 lines...] [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/init-core-data-001 [junit4] 2> 2425406 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4554E57032493FF7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 2425406 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4554E57032493FF7]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /uxa/ [junit4] 2> 2425410 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 2425410 INFO (Thread-12641) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2425410 INFO (Thread-12641) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 2425510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.ZkTestServer start zk server on port:57908 [junit4] 2> 2425510 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425511 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425513 INFO (zkCallback-27911-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56a849b9 name:ZooKeeperConnection Watcher:127.0.0.1:57908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425513 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 2425517 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425517 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425518 INFO (zkCallback-27912-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f16856e name:ZooKeeperConnection Watcher:127.0.0.1:57908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 2425519 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 2425520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 2425520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 2425521 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 2425521 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 2425522 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 2425523 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 2425524 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2425524 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2425529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 2425529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 2425530 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 2425530 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 2425532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 2425532 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 2425533 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 2425533 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 2425534 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 2425534 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 2425535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2425535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2425536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 2425536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 2425536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 2425537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 2425538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425539 INFO (zkCallback-27913-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ed1539b name:ZooKeeperConnection Watcher:127.0.0.1:57908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425539 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 2425540 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425541 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425541 INFO (zkCallback-27914-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f475bab name:ZooKeeperConnection Watcher:127.0.0.1:57908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425541 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425541 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425541 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml [junit4] 2> 2425541 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml [junit4] 2> 2425543 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml [junit4] 2> 2425543 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml [junit4] 2> 2425544 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml [junit4] 2> 2425544 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml [junit4] 2> 2425545 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2425545 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2425546 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt [junit4] 2> 2425546 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt [junit4] 2> 2425547 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt [junit4] 2> 2425547 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt [junit4] 2> 2425547 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml [junit4] 2> 2425548 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml [junit4] 2> 2425548 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json [junit4] 2> 2425548 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json [junit4] 2> 2425549 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt [junit4] 2> 2425549 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt [junit4] 2> 2425550 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt [junit4] 2> 2425550 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt [junit4] 2> 2425551 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt [junit4] 2> 2425551 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt [junit4] 2> 2425552 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml [junit4] 2> 2425552 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml [junit4] 2> 2425626 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/cores/collection1 [junit4] 2> 2425628 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 [junit4] 2> 2425629 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@132e0ac8{/uxa,null,AVAILABLE} [junit4] 2> 2425631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.e.j.s.ServerConnector Started ServerConnector@2955e0a2{HTTP/1.1,[http/1.1]}{127.0.0.1:41289} [junit4] 2> 2425631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.e.j.s.Server Started @2428604ms [junit4] 2> 2425631 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/tempDir-001/control/data, hostContext=/uxa, hostPort=41289, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/cores} [junit4] 2> 2425632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93 [junit4] 2> 2425632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001' [junit4] 2> 2425632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2425632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 2425632 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425633 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425633 INFO (zkCallback-27915-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66af6099 name:ZooKeeperConnection Watcher:127.0.0.1:57908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425633 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 2425634 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/solr.xml [junit4] 2> 2425638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/cores [junit4] 2> 2425638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.CoreContainer New CoreContainer 2061881767 [junit4] 2> 2425638 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001] [junit4] 2> 2425638 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4554E57032493FF7-001/control-001/lib [junit4] 2> 2425639 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57908/solr [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 2425640 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425641 INFO (zkCallback-27918-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a55ecc5 name:ZooKeeperConnection Watcher:127.0.0.1:57908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425641 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 2425642 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$61/1038623823@3431a516 [junit4] 2> 2425643 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 2425643 INFO (zkCallback-27919-thread-1-processing-n:127.0.0.1:41289_uxa) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68433039 name:ZooKeeperConnection Watcher:127.0.0.1:57908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2425643 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 2425644 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 2425645 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 2425647 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 2425648 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 2425649 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 2425650 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 2425651 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 2425651 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 2425652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 2425652 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 2425653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties [junit4] 2> 2425653 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) [junit4] 2> 2425654 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 2425655 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 2425656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41289_uxa ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 2425656 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4554E57032493FF7]) [n:127.0.0.1:41 [...truncated too long message...] > 2) Thread[id=105024, name=IPC Client (1885185032) connection to > localhost/127.0.0.1:41516 from jenkins, state=RUNNABLE, > group=TGRP-HdfsCollectionsAPIDistributedZkTest] [junit4] > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) [junit4] > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) [junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) [junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) [junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) [junit4] > at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) [junit4] > at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) [junit4] > at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) [junit4] > at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) [junit4] > at java.io.FilterInputStream.read(FilterInputStream.java:133) [junit4] > at java.io.FilterInputStream.read(FilterInputStream.java:133) [junit4] > at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:520) [junit4] > at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) [junit4] > at java.io.BufferedInputStream.read(BufferedInputStream.java:265) [junit4] > at java.io.DataInputStream.readInt(DataInputStream.java:387) [junit4] > at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1084) [junit4] > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:979) [junit4] > 3) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 4) Thread[id=105044, name=qtp1346551373-105044, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) [junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 5) Thread[id=105045, name=qtp288419314-105045, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) [junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 6) Thread[id=105043, name=qtp1887659905-105043, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) [junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > 7) Thread[id=105041, name=qtp1813203947-105041, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) [junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47) [junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: [junit4] > 1) Thread[id=105025, name=IPC Parameter Sending Thread #127, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) [junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) [junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > at __randomizedtesting.SeedInfo.seed([4554E57032493FF7]:0) [junit4] Completed [577/619 (6!)] on J0 in 31.84s, 1 test, 1 failure, 2 errors <<< FAILURES! [...truncated 124 lines...] [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J0-20160703_125351_946.sysout [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/heapdumps/java_pid8442.hprof ... [junit4] Heap dump file created [605957567 bytes in 7.171 secs] [junit4] <<< JVM J0: EOF ---- [...truncated 15 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:530: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1427: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984: There were test failures: 619 suites (10 ignored), 2590 tests, 7 suite-level errors, 1 error, 1 failure, 284 ignored (18 assumptions) [seed: 4554E57032493FF7] Total time: 334 minutes 57 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
