See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/373/changes>
Changes: [vinayakumarb] HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) [junping_du] YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du) [mingma] HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma) ------------------------------------------ [...truncated 7077 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.692 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.778 sec - in org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSPermissionChecker Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.548 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSPermissionChecker Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.388 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.011 sec - in org.apache.hadoop.hdfs.server.namenode.TestSaveNamespace Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.234 sec - in org.apache.hadoop.hdfs.server.namenode.TestParallelImageWrite Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.201 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSNamesystemMBean Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestINodeAttributeProvider Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.908 sec - in org.apache.hadoop.hdfs.server.namenode.TestINodeAttributeProvider Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.885 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.676 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.494 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.853 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestQuotasWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.488 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.019 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestNNHealthCheck Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestRemoteNameNodeInfo Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.599 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestRemoteNameNodeInfo Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.566 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 87.236 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.104 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.461 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHAFsck Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.553 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHAAppend Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.111 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.103 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.263 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.098 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAConfiguration Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.096 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHAConfiguration Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.413 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.326 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.672 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 136.711 sec <<< FAILURE! - in org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes testCircularLinkedListWrites(org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes) Time elapsed: 136.538 sec <<< FAILURE! java.lang.AssertionError: Some writers didn't complete in expected runtime! Current writer state:[Circular Writer: directory: /test-0 target length: 50 current item: 50 done: false , Circular Writer: directory: /test-1 target length: 50 current item: 1 done: false ] expected:<0> but was:<2> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:555) at org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes.testCircularLinkedListWrites(TestSeveralNameNodes.java:90) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.613 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.914 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.765 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.281 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestRequestHedgingProxyProvider Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.528 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestRequestHedgingProxyProvider Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.675 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHAStateTransitions Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.525 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.399 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 175.662 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.989 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.96 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA Results : Failed tests: TestLazyPersistReplicaPlacement.testSynchronousEviction:92->LazyPersistTestCase.verifyRamDiskJMXMetric:483 expected:<1> but was:<0> TestLazyPersistLockedMemory.testReleaseOnEviction:122->LazyPersistTestCase.verifyRamDiskJMXMetric:483 expected:<1> but was:<0> TestSeveralNameNodes.testCircularLinkedListWrites:90 Some writers didn't complete in expected runtime! Current writer state:[Circular Writer: directory: /test-0 target length: 50 current item: 50 done: false , Circular Writer: directory: /test-1 target length: 50 current item: 1 done: false ] expected:<0> but was:<2> Tests in error: TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack:368->doTestSingleRackClusterIsSufficientlyReplicated:376->addBlockOnNodes:443 WrongTypeOfReturnValue Tests run: 1593, Failures: 3, Errors: 1, Skipped: 3 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:56 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 01:47 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.061 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:51 h [INFO] Finished at: 2015-09-15T19:34:23+00:00 [INFO] Final Memory: 74M/937M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs> && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter5622369375655951949.jar> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire2084065310733083493tmp> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_1354584892837632762992tmp> [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #222 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 5379001 bytes Compression is 0.0% Took 5.2 sec Recording test results Updating YARN-313 Updating HDFS-9008 Updating HDFS-9067