Re: .23 compile times

2012-02-17 Thread Daryn Sharp
Very nice improvement! How long is "mvn install -DskipTests -Dmaven.javadoc.skip"? Assuming that's fast, is there possibly a way to allow hadoop to run out of the checkedout tree? Maybe through the CLASSPATH, or by subprojects copying the built jars into the dist area? The ideal would be to

Re: .23 compile times

2012-02-16 Thread Alejandro Abdelnur
A 'mvn package -DskipTests -Pdist' (developer) with no changes takes 3.35mins The biggest offenders are: [INFO] Apache Hadoop Common .. SUCCESS [43.299s] [INFO] Apache Hadoop HDFS SUCCESS [54.776s] [INFO] hadoop-yarn-api ..

Re: .23 compile times

2012-02-16 Thread Daryn Sharp
Wow, nice! How long is a rebuild with no changes? I'd be delighted if there was a dev profile that just did the bare minimum to produce a working env. Daryn On Feb 16, 2012, at 3:25 PM, Alejandro Abdelnur wrote: > I've just done some tweaks in the POMs and I'm cutting the 8.30min full > dist

Re: .23 compile times

2012-02-16 Thread Alejandro Abdelnur
I've just done some tweaks in the POMs and I'm cutting the 8.30min full dist build down to 3.45min. I'm removing all javadoc stuff from the dist profile. I think we should introduce a developer profile that does this. Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache is taking

Re: .23 compile times

2012-02-15 Thread Daryn Sharp
Hi Sriram, You may want to try adding your source tree to Spotlight's privacy list, otherwise it's busy trying to index files as fast as the build is writing them. If you are (un)fortunate enough to be running anti-virus sw, then it too is scurrying along behind your build checking every file.

Re: .23 compile times

2012-02-15 Thread Todd Lipcon
Hi Sriram, I also do -Dmaven.skip.javadoc=true usually and that cuts out a couple minutes. Unless you need a tarball, you can also drop -Ptar. When I'm just making quick changes confined to the java code, I usually just use "mvn -Dskiptests install" from within the hdfs project, then manually cp

Re: .23 compile times

2012-02-15 Thread Harsh J
Sriram, My package command didn't take as long with the same command -- where do you see it getting stuck at most of the times? Which particular target (right term?) seems to take the highest time to complete? On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao wrote: > Folks, > > The build takes forev

.23 compile times

2012-02-15 Thread Sriram Rao
Folks, The build takes forever: mvn package -Pdist -DskipTests -Dtar [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 6:25.399s [INFO] Fin