See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1101/changes>
Changes: [jing9] HDFS-10216. Distcp -diff throws exception when handling relative path. [kihwal] HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by [xyao] HDFS-10286. Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties. [wangda] MAPREDUCE-6513. MR job got hanged forever when one NM unstable for some [wang] HADOOP-12811. Change kms server port number which conflicts with HMaster ------------------------------------------ [...truncated 29263 lines...] Running org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Tests run: 61, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.924 sec - in org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Tests run: 61, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.847 sec - in org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 71, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.85 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.65 sec - in org.apache.hadoop.fs.TestUnbuffer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.964 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.226 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.326 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.169 sec - in org.apache.hadoop.fs.TestFcHdfsPermission Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestGlobPaths Tests run: 36, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 4.979 sec - in org.apache.hadoop.fs.TestGlobPaths Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.144 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.844 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.015 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.542 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.164 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.203 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.205 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.173 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.194 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.622 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.478 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.189 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.774 sec - in org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.799 sec - in org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tools.TestJMXGet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.786 sec - in org.apache.hadoop.tools.TestJMXGet Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tools.TestTools Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.429 sec - in org.apache.hadoop.tools.TestTools Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tools.TestHdfsConfigFields Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.741 sec - in org.apache.hadoop.tools.TestHdfsConfigFields Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.428 sec - in org.apache.hadoop.TestRefreshCallQueue Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.694 sec - in org.apache.hadoop.net.TestNetworkTopology Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.728 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.605 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestDeleteCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.067 sec - in org.apache.hadoop.cli.TestDeleteCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.468 sec - in org.apache.hadoop.cli.TestAclCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestErasureCodingCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.519 sec - in org.apache.hadoop.cli.TestErasureCodingCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.839 sec - in org.apache.hadoop.cli.TestXAttrCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.305 sec - in org.apache.hadoop.cli.TestHDFSCLI Results : Failed tests: TestDFSStripedOutputStreamWithFailure180>TestDFSStripedOutputStreamWithFailure$TestBase.test8:538->TestDFSStripedOutputStreamWithFailure$TestBase.run:527 failed, dn=0, length=4063232java.io.IOException: Failed at i=4607 at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:443) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:419) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:322) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.run(TestDFSStripedOutputStreamWithFailure.java:527) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.test8(TestDFSStripedOutputStreamWithFailure.java:538) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) Caused by: java.io.IOException: Failed to get 6 nodes from namenode: blockGroupSize= 9, blocks.length= 3 at org.apache.hadoop.hdfs.DFSStripedOutputStream.allocateNewBlock(DFSStripedOutputStream.java:466) at org.apache.hadoop.hdfs.DFSStripedOutputStream.writeChunk(DFSStripedOutputStream.java:506) at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:217) at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:164) at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:145) at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:79) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:48) at java.io.DataOutputStream.write(DataOutputStream.java:88) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:441) ... 13 more Tests in error: TestShortCircuitLocalRead.testSmallFileLocalRead:308->doTestShortCircuitRead:241->doTestShortCircuitReadImpl:286->checkFileContent:157 » IndexOutOfBounds TestShortCircuitLocalRead.testLocalReadLegacy:316->doTestShortCircuitReadLegacy:235->doTestShortCircuitReadImpl:286->checkFileContent:157 » IndexOutOfBounds TestShortCircuitLocalRead.testLocalReadFallback:327->doTestShortCircuitReadLegacy:235->doTestShortCircuitReadImpl:286->checkFileContent:157 » IndexOutOfBounds TestBlocksWithNotEnoughRacks.testUnderReplicatedUsesNewRacks:155->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testCorruptBlockRereplicatedAcrossRacks:191->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testReduceReplFactorRespectsRackPolicy:244->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testReplDueToNodeFailRespectsRackPolicy:277->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testSufficientlySingleReplBlockUsesNewRack:121->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testNodeDecomissionWithOverreplicationRespectsRackPolicy:429->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testNodeDecomissionRespectsRackPolicy:384->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testSufficientlyReplBlocksUsesNewRack:88->getConf:58 NoClassDefFound TestBlocksWithNotEnoughRacks.testReduceReplFactorDueToRejoinRespectsRackPolicy:333->getConf:58 NoClassDefFound TestDistributedFileSystem.testDFSClientPeerWriteTimeout:1113 IO write timedout... TestWriteReadStripedFile.testFileSmallerThanOneCell1:96->testOneFileUsingDFSStripedInputStream:200->testOneFileUsingDFSStripedInputStream:224 » TestWriteReadStripedFile.testFileSmallerThanOneCell2:102->testOneFileUsingDFSStripedInputStream:200->testOneFileUsingDFSStripedInputStream:224 » TestDFSStripedOutputStream.testFileMoreThanOneStripe1:118->testOneFile:162 » IO TestDFSStripedOutputStream.setup:68 » IO Cannot remove data directory: /home/j... TestDFSStripedOutputStream.setup:68 » IO Cannot remove data directory: /home/j... TestDFSStripedOutputStream.setup:68 » IO Cannot remove data directory: /home/j... TestDFSStripedOutputStream.testFileFullBlockGroup:135->testOneFile:163 » Timeout TestFileAppend4.testRecoverFinalizedBlock:189->recoverFile:124 » test timed o... TestDFSStripedOutputStreamWithFailure.testAddBlockWhenNoSufficientParityNumOfNodes:310 » TestDFSStripedOutputStreamWithFailure.testBlockTokenExpired:238->runTest:419->write:443 IO TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56:211->runTestWithMultipleFailure:342->runTest:419->write:443 IO TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks:78->readFileWithMissingBlocks:115 » TestReadStripedFileWithDecoding>Object.wait:-2 » test timed out after 300000 ... TestReadStripedFileWithDecoding>Object.wait:-2 » test timed out after 300000 ... TestDFSUpgradeFromImage.testUpgradeFromRel1BBWImage:628->upgradeAndVerify:606->verifyFileSystem:229->verifyDir:214->dfsOpenFileWithRetries:178 » IO Tests run: 4360, Failures: 1, Errors: 24, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [04:02 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 04:06 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.087 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 04:10 h [INFO] Finished at: 2016-04-14T23:20:20+00:00 [INFO] Final Memory: 56M/573M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There was a timeout or other error in the fork -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results