See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2838/changes>
Changes: [junping_du] HDFS-9456. BlockPlacementPolicyWithNodeGroup should override ------------------------------------------ [...truncated 5662 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.227 sec - in org.apache.hadoop.hdfs.TestAbandonBlock Running org.apache.hadoop.hdfs.TestExternalBlockReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.424 sec - in org.apache.hadoop.hdfs.TestExternalBlockReader Running org.apache.hadoop.hdfs.TestFileCreationClient Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.715 sec - in org.apache.hadoop.hdfs.TestFileCreationClient Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.566 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020 Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.578 sec - in org.apache.hadoop.hdfs.TestFileCreationDelete Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.624 sec - in org.apache.hadoop.tracing.TestTraceAdmin Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.694 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.717 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.89 sec - in org.apache.hadoop.net.TestNetworkTopology Running org.apache.hadoop.TestGenericRefresh Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.178 sec - in org.apache.hadoop.TestGenericRefresh Running org.apache.hadoop.tools.TestHdfsConfigFields Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.666 sec - in org.apache.hadoop.tools.TestHdfsConfigFields Running org.apache.hadoop.tools.TestTools Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.442 sec - in org.apache.hadoop.tools.TestTools Running org.apache.hadoop.tools.TestJMXGet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.258 sec - in org.apache.hadoop.tools.TestJMXGet Running org.apache.hadoop.cli.TestErasureCodingCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.492 sec - in org.apache.hadoop.cli.TestErasureCodingCLI Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.624 sec - in org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.356 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.886 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestDeleteCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.41 sec - in org.apache.hadoop.cli.TestDeleteCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.662 sec - in org.apache.hadoop.cli.TestXAttrCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.603 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.22 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.501 sec - in org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.388 sec - in org.apache.hadoop.fs.TestFcHdfsSetUMask Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.434 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.499 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.902 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.587 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.842 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.857 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.216 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.947 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.311 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.953 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.812 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.326 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Running org.apache.hadoop.fs.TestSymlinkHdfsDisable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.844 sec - in org.apache.hadoop.fs.TestSymlinkHdfsDisable Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.529 sec - in org.apache.hadoop.fs.permission.TestStickyBit Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.119 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.365 sec - in org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.365 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.25 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.698 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.822 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.884 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.857 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.67 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.008 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.862 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.92 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.777 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 71, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.641 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Running org.apache.hadoop.fs.TestGlobPaths Tests run: 36, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 11.697 sec - in org.apache.hadoop.fs.TestGlobPaths Running org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Tests run: 74, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 25.221 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.927 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Running org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 186.027 sec - in org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.302 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.702 sec - in org.apache.hadoop.fs.TestFcHdfsPermission Running org.apache.hadoop.fs.TestEnhancedByteBufferAccess Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 37.343 sec - in org.apache.hadoop.fs.TestEnhancedByteBufferAccess Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.279 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.992 sec - in org.apache.hadoop.fs.TestUnbuffer Results : Failed tests: TestSafeModeWithStripedFile.testStripedFile1:82->doTest:156 null TestDataNodeVolumeFailure.testUnderReplicationAfterVolFailure:412 There is no under replicated block after volume failure TestBlockReplacement.testDeletedBlockWhenAddBlockIsInEdit:436 The block should be only on 1 datanode expected:<1> but was:<2> TestRequestHedgingProxyProvider.testHedgingWhenOneFails:78 Wanted but not invoked: namenodeProtocols.getStats(); -> at org.apache.hadoop.hdfs.server.namenode.ha.TestRequestHedgingProxyProvider.testHedgingWhenOneFails(TestRequestHedgingProxyProvider.java:78) Actually, there were zero interactions with this mock. TestDFSStripedOutputStreamWithFailure170>TestDFSStripedOutputStreamWithFailure$TestBase.test3:533->TestDFSStripedOutputStreamWithFailure$TestBase.run:527 failed, dn=6, length=3735552java.io.IOException: Failed at i=1967615 at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:443) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:419) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:322) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.run(TestDFSStripedOutputStreamWithFailure.java:527) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.test3(TestDFSStripedOutputStreamWithFailure.java:533) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) Caused by: java.io.IOException: Data streamers failed while creating new block streams: [#4: failed, blk_-9223372036854775772_1002, #5: failed, blk_-9223372036854775771_1002, #3: failed, blk_-9223372036854775773_1002, #1: failed, blk_-9223372036854775775_1002, #2: failed, blk_-9223372036854775774_1002, #0: failed, blk_-9223372036854775776_1002, #8: failed, blk_-9223372036854775768_1002]. There are not enough healthy streamers. at org.apache.hadoop.hdfs.DFSStripedOutputStream.checkStreamerFailures(DFSStripedOutputStream.java:631) at org.apache.hadoop.hdfs.DFSStripedOutputStream.writeChunk(DFSStripedOutputStream.java:547) at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:217) at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:164) at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:145) at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:79) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:48) at java.io.DataOutputStream.write(DataOutputStream.java:88) at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:441) ... 13 more Tests in error: TestDirectoryScanner.testThrottling:584->createFile:108->Object.wait:503->Object.wait:-2 ยป Tests run: 4169, Failures: 5, Errors: 1, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [05:45 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 05:32 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.130 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:38 h [INFO] Finished at: 2016-02-17T09:27:08+00:00 [INFO] Final Memory: 56M/715M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results