Re: we need a fix: precommit failures correlate to hdfs patches

2015-05-04 Thread Allen Wittenauer
FWIW, I’m working on getting the Jenkins race conditions that Sean pointed out fixed in HADOOP-11917. On May 4, 2015, at 2:23 PM, Chris Nauroth wrote: > If we suspect long run times are a potential root cause, then another > thing we could try is turning on parallel test execution. To do tha

Re: we need a fix: precommit failures correlate to hdfs patches

2015-05-04 Thread Chris Nauroth
If we suspect long run times are a potential root cause, then another thing we could try is turning on parallel test execution. To do that, we'd add the -Pparallel-tests argument and possibly tune -DtestsThreadCount=N. (The default for N is 4.) https://issues.apache.org/jira/browse/HADOOP-9287

Re: we need a fix: precommit failures correlate to hdfs patches

2015-05-03 Thread Sean Busbey
The patch artifact directory in the mainline hadoop jenkins jobs are outside of the workspace. I'm not sure what, if anything, jenkins guarantees about files out of the main workspace. They all write to ${WORKSPACE}/../patchProcess, which will probably collide if multiple runs happen on the same m

we need a fix: precommit failures correlate to hdfs patches

2015-05-03 Thread Allen Wittenauer
So, as some may have noticed, I slammed the Jenkins servers over the weekend to get some recent patch test runs in JIRA for the bug bash this week. I've had a suspicion for a while now that either the long run times of the hadoop-hdfs module unit tests (typically 2+ hours) or t