See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2714/changes>
Changes: [zhz] HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai [zhz] Update CHANGES.txt: move HDFS-9626 and HDFS-9630 to the section of [jlowe] Add MR-5982 and MR-6492 to 2.6.4 ------------------------------------------ [...truncated 7924 lines...] Running org.apache.hadoop.hdfs.TestIsMethodSupported Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.573 sec - in org.apache.hadoop.hdfs.TestIsMethodSupported Running org.apache.hadoop.hdfs.TestRecoverStripedFile Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.66 sec - in org.apache.hadoop.hdfs.TestRecoverStripedFile Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.928 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestGetFileChecksum Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.553 sec - in org.apache.hadoop.hdfs.TestGetFileChecksum Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.359 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.917 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.util.TestBestEffortLongFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.304 sec - in org.apache.hadoop.hdfs.util.TestBestEffortLongFile Running org.apache.hadoop.hdfs.util.TestStripedBlockUtil Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.146 sec - in org.apache.hadoop.hdfs.util.TestStripedBlockUtil Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.314 sec - in org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.405 sec - in org.apache.hadoop.hdfs.util.TestMD5FileUtils Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.305 sec - in org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Running org.apache.hadoop.hdfs.util.TestXMLUtils Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.103 sec - in org.apache.hadoop.hdfs.util.TestXMLUtils Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.27 sec - in org.apache.hadoop.hdfs.util.TestLightWeightHashSet Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.104 sec - in org.apache.hadoop.hdfs.util.TestCyclicIteration Running org.apache.hadoop.hdfs.util.TestDiff Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.115 sec - in org.apache.hadoop.hdfs.util.TestDiff Running org.apache.hadoop.hdfs.TestRemoteBlockReader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.261 sec - in org.apache.hadoop.hdfs.TestRemoteBlockReader Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.131 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Running org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.889 sec - in org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Running org.apache.hadoop.hdfs.TestReservedRawPaths Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.255 sec - in org.apache.hadoop.hdfs.TestReservedRawPaths Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.32 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 10.346 sec - in org.apache.hadoop.hdfs.TestAppendDifferentChecksum Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.145 sec - in org.apache.hadoop.hdfs.TestDFSRollback Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.402 sec - in org.apache.hadoop.hdfs.TestMiniDFSCluster Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.057 sec - in org.apache.hadoop.hdfs.TestClientReportBadBlock Running org.apache.hadoop.hdfs.TestFileStatusWithECPolicy Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.792 sec - in org.apache.hadoop.hdfs.TestFileStatusWithECPolicy Running org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.159 sec - in org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.797 sec - in org.apache.hadoop.hdfs.TestLeaseRecovery2 Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.36 sec - in org.apache.hadoop.hdfs.protocol.TestLayoutVersion Running org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.541 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Running org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.557 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Running org.apache.hadoop.hdfs.protocol.TestAnnotations Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.207 sec - in org.apache.hadoop.hdfs.protocol.TestAnnotations Running org.apache.hadoop.hdfs.protocol.TestLocatedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.292 sec - in org.apache.hadoop.hdfs.protocol.TestLocatedBlock Running org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.199 sec - in org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.982 sec - in org.apache.hadoop.hdfs.TestAbandonBlock Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.888 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190 Running org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.842 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.704 sec - in org.apache.hadoop.hdfs.TestFileAppendRestart Running org.apache.hadoop.hdfs.TestFetchImage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.84 sec - in org.apache.hadoop.hdfs.TestFetchImage Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.351 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200 Running org.apache.hadoop.hdfs.TestSafeModeWithStripedFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.356 sec - in org.apache.hadoop.hdfs.TestSafeModeWithStripedFile Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.355 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.366 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.518 sec - in org.apache.hadoop.hdfs.TestFileCreationDelete Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.126 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.363 sec - in org.apache.hadoop.hdfs.TestHDFSFileSystemContract Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.764 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.922 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Running org.apache.hadoop.hdfs.TestParallelReadUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.043 sec - in org.apache.hadoop.hdfs.TestParallelReadUtil Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.673 sec - in org.apache.hadoop.hdfs.TestDFSUpgrade Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.981 sec - in org.apache.hadoop.hdfs.TestDFSShell Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.789 sec - in org.apache.hadoop.hdfs.TestFileAppend2 Running org.apache.hadoop.hdfs.TestKeyProviderCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.706 sec - in org.apache.hadoop.hdfs.TestKeyProviderCache Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.465 sec - in org.apache.hadoop.hdfs.TestListFilesInDFS Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.378 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.856 sec - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.352 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Running org.apache.hadoop.hdfs.TestDFSOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.399 sec - in org.apache.hadoop.hdfs.TestDFSOutputStream Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.936 sec - in org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.509 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.334 sec - in org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Running org.apache.hadoop.hdfs.TestDFSPermission Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.65 sec - in org.apache.hadoop.hdfs.TestDFSPermission Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.879 sec - in org.apache.hadoop.hdfs.TestRestartDFS Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.475 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.017 sec - in org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.39 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestDeleteCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.675 sec - in org.apache.hadoop.cli.TestDeleteCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.368 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.cli.TestErasureCodingCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.655 sec - in org.apache.hadoop.cli.TestErasureCodingCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.599 sec - in org.apache.hadoop.cli.TestXAttrCLI Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.879 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.security.TestPermissionSymlinks Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.986 sec - in org.apache.hadoop.security.TestPermissionSymlinks Running org.apache.hadoop.security.TestPermission Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.849 sec - in org.apache.hadoop.security.TestPermission Running org.apache.hadoop.security.TestRefreshUserMappings Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.319 sec - in org.apache.hadoop.security.TestRefreshUserMappings Results : Tests in error: TestNNThroughputBenchmark.testNNThroughput:53 » NotReplicatedYet Not replicate... TestDtpHttp2.setUp:82 » NoClassDefFound org/apache/hadoop/util/ShutdownHookMan... TestLazyPersistFiles.testDisableLazyPersistFileScrubber:127->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testConcurrentWrites:236->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testFileShouldNotDiscardedIfNNRestarted:156->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testCorruptFilesAreDiscarded:93->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testConcurrentRead:185->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testTruncateIsDenied:71->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestLazyPersistFiles.testAppendIsDenied:50->LazyPersistTestCase.startUpCluster:294 » NoClassDefFound TestSpaceReservation.testWithDefaultBlockSize:207->createFileAndTestSpaceReservation:179 » NoClassDefFound TestSpaceReservation.testTmpSpaceReserve:407->performReReplication:472 » test... TestSpaceReservation.testWithNonDefaultBlockSize:214->createFileAndTestSpaceReservation:179 » NoClassDefFound Tests run: 4134, Failures: 0, Errors: 12, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [04:23 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 03:20 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.062 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:24 h [INFO] Finished at: 2016-01-11T22:44:24+00:00 [INFO] Final Memory: 57M/742M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results
