Thanks Robert for reminding me. Because there was a similar discussion about this in the Jenkins Mac Slave. In fact the issue was not caused by this limit as Jenkins Slave already started with 2048 limit.
Please don't raise the hardcoded test limit. It will likely break on Jenkins anyways. Better have a hard and low limit in test framework instead of hard to reproduce failures in Jenkins. Uwe Am 8. März 2017 17:50:04 MEZ schrieb Robert Muir <[email protected]>: >If you don't like the limit for your specific test: use >@SuppressFileSystems annotation to suppress it. > >But it is really insane for a unit test to use so many index files, >and it is important to reproduce such bugs when they do happen. > >On Wed, Mar 8, 2017 at 11:46 AM, Chris Hostetter ><[email protected]> wrote: >> >> The exception is being thrown by >org.apache.lucene.mockfile.HandleLimitFS, >> so the OS level utlimit isn't relevant (as long as it's greter then >2048, >> hardcoded in TestRuleTemporaryFilesCleanup) >> >> With the test creating 2 diff indexes, that means each index index >gets an >> effective max open files limit of ~1024 files ... and with >> RandomSimilarity it might be leaving a lot of small segments on >"disk" for >> both of those indexes -- which will have at least 100,000 docs in >each >> because this is a nightly run.... >> >> I haven't tested this (my co is currently dirty and i'm in the middle >of >> something) but i suspect the seed will reproduce anywhere. >> >> See also SOLR-10234 where i recently pointed out similar concerns >about >> TestRuleTemporaryFilesCleanup's fixed limit of 2048 for the entire >JVM, >> even when the JVM itself is trying to simulate multiple diff indexes >(or >> completley distint nodes in the solr cloud test case). >> >> >> >> : Date: Wed, 8 Mar 2017 11:29:45 -0500 >> : From: Steve Rowe <[email protected]> >> : Reply-To: [email protected] >> : To: [email protected] >> : Subject: Re: [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 303 - >Still >> : Unstable >> : >> : >> : > On Mar 8, 2017, at 8:38 AM, Apache Jenkins Server ><[email protected]> wrote: >> : > >> : > Build: >https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/303/ >> : > >> : > 2 tests failed. >> : > FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3 >> : > >> : > Error Message: >> : > >/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: >Too many open files >> : > >> : > Stack Trace: >> : > java.nio.file.FileSystemException: >/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: >Too many open files >> : >> : I logged in as the jenkins user on lucene1-us-west.apache.org (the >‘lucene' jenkins slave), and ‘ulimit -aHS’ says (in part): >> : >> : open files (-n) 1048576 >> : >> : I think this is the maximum value. >> : >> : Not sure what can be done here? >> : >> : -- >> : Steve >> : www.lucidworks.com >> : >> : >> : >--------------------------------------------------------------------- >> : To unsubscribe, e-mail: [email protected] >> : For additional commands, e-mail: [email protected] >> : >> : >> >> -Hoss >> http://www.lucidworks.com/ >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] > >--------------------------------------------------------------------- >To unsubscribe, e-mail: [email protected] >For additional commands, e-mail: [email protected] -- Uwe Schindler Achterdiek 19, 28357 Bremen https://www.thetaphi.de
