If you don't like the limit for your specific test: use @SuppressFileSystems annotation to suppress it.
But it is really insane for a unit test to use so many index files, and it is important to reproduce such bugs when they do happen. On Wed, Mar 8, 2017 at 11:46 AM, Chris Hostetter <[email protected]> wrote: > > The exception is being thrown by org.apache.lucene.mockfile.HandleLimitFS, > so the OS level utlimit isn't relevant (as long as it's greter then 2048, > hardcoded in TestRuleTemporaryFilesCleanup) > > With the test creating 2 diff indexes, that means each index index gets an > effective max open files limit of ~1024 files ... and with > RandomSimilarity it might be leaving a lot of small segments on "disk" for > both of those indexes -- which will have at least 100,000 docs in each > because this is a nightly run.... > > I haven't tested this (my co is currently dirty and i'm in the middle of > something) but i suspect the seed will reproduce anywhere. > > See also SOLR-10234 where i recently pointed out similar concerns about > TestRuleTemporaryFilesCleanup's fixed limit of 2048 for the entire JVM, > even when the JVM itself is trying to simulate multiple diff indexes (or > completley distint nodes in the solr cloud test case). > > > > : Date: Wed, 8 Mar 2017 11:29:45 -0500 > : From: Steve Rowe <[email protected]> > : Reply-To: [email protected] > : To: [email protected] > : Subject: Re: [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 303 - Still > : Unstable > : > : > : > On Mar 8, 2017, at 8:38 AM, Apache Jenkins Server > <[email protected]> wrote: > : > > : > Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/303/ > : > > : > 2 tests failed. > : > FAILED: org.apache.lucene.index.TestIndexSorting.testRandom3 > : > > : > Error Message: > : > > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: > Too many open files > : > > : > Stack Trace: > : > java.nio.file.FileSystemException: > /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J2/temp/lucene.index.TestIndexSorting_4609011308FB57E6-001/tempDir-004/_e4_Lucene50_0.tim: > Too many open files > : > : I logged in as the jenkins user on lucene1-us-west.apache.org (the ‘lucene' > jenkins slave), and ‘ulimit -aHS’ says (in part): > : > : open files (-n) 1048576 > : > : I think this is the maximum value. > : > : Not sure what can be done here? > : > : -- > : Steve > : www.lucidworks.com > : > : > : --------------------------------------------------------------------- > : To unsubscribe, e-mail: [email protected] > : For additional commands, e-mail: [email protected] > : > : > > -Hoss > http://www.lucidworks.com/ > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
