Re: test-patch failing with OOM errors in javah

2013-10-31 Thread Jason Lowe
Pinged Bobby who has access to the machines, and this is indeed what is happening. There were two cases: 1) When TestUberAM times out the minicluster it is running along with its MRAppMaster process can escape. There are a ton of threads in those processes, so it doesn't take very many of th

Re: test-patch failing with OOM errors in javah

2013-10-31 Thread Jason Lowe
I don't think that OOM error below indicates it needs more heap space, as it's complaining about the ability to create a new native thread. That usually is caused by lack of available virtual address space or hitting process ulimits. What's most likely going on is the jenkins user is hitting

Re: test-patch failing with OOM errors in javah

2013-10-30 Thread Omkar Joshi
btw I am doing this on my local mac machine.. not on build machines. Thanks, Omkar Joshi *Hortonworks Inc.* On Wed, Oct 30, 2013 at 4:47 PM, Omkar Joshi wrote: > yes even I do the same.. I just use this to build > > export _JAVA_OPTIONS="-Djava.awt.headless=true -X

Re: test-patch failing with OOM errors in javah

2013-10-30 Thread Omkar Joshi
yes even I do the same.. I just use this to build export _JAVA_OPTIONS="-Djava.awt.headless=true -Xmx2048m -Xms2048m" mvn clean install package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true Thanks, Omkar Joshi *Hortonworks Inc.* On Wed, Oct 30, 2013 at 3:39 PM

Re: test-patch failing with OOM errors in javah

2013-10-30 Thread Roman Shaposhnik
I can take a look sometime later today. Meantime I can only say that I've been running into 1Gb limit in a few builds as of late. These days -- I just go with 2G by default. Thanks, Roman. On Wed, Oct 30, 2013 at 3:33 PM, Alejandro Abdelnur wrote: > The following is happening in builds for MAPRE

test-patch failing with OOM errors in javah

2013-10-30 Thread Alejandro Abdelnur
The following is happening in builds for MAPREDUCE and YARN patches. I've seen the failures in hadoop5 and hadoop7 machines. I've increased Maven memory to 1GB (export MAVEN_OPTS="-Xmx1024m" in the jenkins jobs) but still some failures persist: https://builds.apache.org/job/PreCommit-MAPREDUCE-Buil