Re: Local repo sharing for maven builds

I just filed YETUS-4 for supporting additional maven args. https://issues.apache.org/jira/browse/YETUS-4 Theoretically, we should be able to run unittests without a full `mvn install` right? The "test" phase comes before "package" or "install", so I figured it only needed class files. Maybe the m

Re: Local repo sharing for maven builds

On Fri, Sep 18, 2015 at 2:42 PM, Allen Wittenauer wrote: > As far as Yetus goes, we've got a JIRA open to provide for per-instance > caches when > using the docker container code. I've got it in my head how I think we can do > it, but just > haven't had a chance to code it. So once that gets wr

Re: Local repo sharing for maven builds

a) Multi-module patches are always troublesome because it makes the test system do significantly more work. For Yetus, we've pared it down as far as we can go to get *some* speed increases, but if a patch does something like hit every pom.xml file, there's nothing that can be done to make it be

Re: Local repo sharing for maven builds

The increase of frequency might have been due to the refactor of hadoop-hdfs-client-*.jar out of the main hadoop-hdfs-*.jar. I don't have the oveall metrics of how often this happens when anyone changes protobuf. But based on HDFS-9004, 4 of 5 runs have this issue, which is a lot for any patch that

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #428

See

[jira] [Created] (HADOOP-12424) Add a function to build unique cache key for Token

Xiaobing Zhou created HADOOP-12424: -- Summary: Add a function to build unique cache key for Token Key: HADOOP-12424 URL: https://issues.apache.org/jira/browse/HADOOP-12424 Project: Hadoop Common

Build failed in Jenkins: Hadoop-common-trunk-Java8 #427

See Changes: [Arun Suresh] YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh) -- [...truncated 5604 lin

Re: Local repo sharing for maven builds

Okay, some browsing of Jenkins docs [1] says that we could key the maven.repo.local off of $EXECUTOR_NUMBER to do per-executor repos like Bernd recommended, but that still requires some hook into test-patch.sh. Regarding install, I thought all we needed to install was hadoop-maven-plugins, but we

Re: Local repo sharing for maven builds

The collisions have been happening for about a year now. The frequency is increasing, but not enough to be particularly worrisome. (So I'm slightly amused that one blowing up is suddenly a major freakout.) Making changes to the configuration without knowing what one is doing is probably a b

Build failed in Jenkins: Hadoop-common-trunk-Java8 #426

See Changes: [wheat9] MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. -- [...truncated 3758

Build failed in Jenkins: Hadoop-common-trunk-Java8 #425

See Changes: [jlowe] Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 -- [...truncated 5939 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;

Re: Local repo sharing for maven builds

Sangjin, you should have access to the precommit jobs if you log in with your Apache credentials, even as a branch committer. https://builds.apache.org/job/PreCommit-HDFS-Build/configure The actual maven invocation is managed by test-patch.sh though. test-patch.sh has a MAVEN_ARGS which looks lik

Re: Local repo sharing for maven builds

You can use one per build processor, that reduces concurrent updates but still keeps the cache function. And then try to avoid using install. -- http://bernd.eckenfels.net -Original Message- From: Andrew Wang To: "common-dev@hadoop.apache.org" Cc: Andrew Bayer , Sangjin Lee , Lei Xu

Re: Local repo sharing for maven builds

Are we using maven.repo.local in our pre-commit or commit jobs? We cannot see the configuration of these jenkins jobs. On Fri, Sep 18, 2015 at 11:41 AM, Andrew Wang wrote: > I think each job should use a maven.repo.local within its workspace like > abayer said. This means lots of downloading, bu

Re: Local repo sharing for maven builds

I think each job should use a maven.repo.local within its workspace like abayer said. This means lots of downloading, but it's isolated. If we care about download time, we could also bootstrap with a tarred .m2/repository after we've run a `mvn compile`, so before it installs the hadoop artifacts.

Re: Local repo sharing for maven builds

+hadoop common dev. Any suggestions? On Fri, Sep 18, 2015 at 10:41 AM, Andrew Bayer wrote: > You can change your maven call to use a different repository - I believe > you do that with -Dmaven.repository.local=path/to/repo > On Sep 18, 2015 19:39, "Ming Ma" wrote: > >> Hi, >> >> We are seeing

Re: [YETUS] Yetus TLP approved

The Apache Yetus dev list is now active: http://mail-archives.apache.org/mod_mbox/yetus-dev/ The first post there has a pointer to the rest of the project resources and the status of getting things set up. On Thu, Sep 17, 2015 at 10:59 AM, Sean Busbey wrote: > Hi Folks! > > At yesterday's ASF b

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #422

See

Jenkins build is back to normal : Hadoop-Common-trunk #1719

See

Build failed in Jenkins: Hadoop-common-trunk-Java8 #421

See Changes: [yzhang] HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) -- [...truncated 5634 lines...] Tests run: 5, Failur

Build failed in Jenkins: Hadoop-common-trunk-Java8 #420

See Changes: [vinayakumarb] HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) -- [...truncated 5600 lines...] Tests r

Build failed in Jenkins: Hadoop-Common-trunk #1718

See Changes: [vinayakumarb] HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) -- [...truncated 8253 lines...] [javadoc]

[jira] [Created] (HADOOP-12423) ShutdownHookManager throws exception if JVM is already being shut down

Abhishek Agarwal created HADOOP-12423: - Summary: ShutdownHookManager throws exception if JVM is already being shut down Key: HADOOP-12423 URL: https://issues.apache.org/jira/browse/HADOOP-12423 Pr

Build failed in Jenkins: Hadoop-Common-trunk #1717

See Changes: [stevel] YARN-2597 MiniYARNCluster should propagate reason for AHS not starting -- [...truncated 5218 lines...] Running org.apache.hadoop.metrics2.impl.TestSinkQueue Tests run: 8