See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2525/changes>
Changes: [ozawa] MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed ------------------------------------------ [...truncated 8492 lines...] Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.75 sec - in org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Running org.apache.hadoop.hdfs.util.TestStripedBlockUtil Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.061 sec - in org.apache.hadoop.hdfs.util.TestStripedBlockUtil Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.455 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached Running org.apache.hadoop.hdfs.TestLeaseRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.966 sec - in org.apache.hadoop.hdfs.TestLeaseRecovery Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.062 sec - in org.apache.hadoop.hdfs.TestFileCreationDelete Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.66 sec - in org.apache.hadoop.hdfs.TestDFSRemove Running org.apache.hadoop.hdfs.TestSafeMode Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.225 sec - in org.apache.hadoop.hdfs.TestSafeMode Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.953 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Running org.apache.hadoop.hdfs.TestDFSFinalize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.451 sec - in org.apache.hadoop.hdfs.TestDFSFinalize Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.191 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestReservedRawPaths Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.608 sec - in org.apache.hadoop.hdfs.TestReservedRawPaths Running org.apache.hadoop.hdfs.TestBalancerBandwidth Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.148 sec - in org.apache.hadoop.hdfs.TestBalancerBandwidth Running org.apache.hadoop.hdfs.security.TestClientProtocolWithDelegationToken Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.111 sec - in org.apache.hadoop.hdfs.security.TestClientProtocolWithDelegationToken Running org.apache.hadoop.hdfs.security.TestDelegationToken Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.566 sec - in org.apache.hadoop.hdfs.security.TestDelegationToken Running org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.1 sec - in org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser Running org.apache.hadoop.hdfs.security.token.block.TestBlockToken Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.946 sec - in org.apache.hadoop.hdfs.security.token.block.TestBlockToken Running org.apache.hadoop.hdfs.TestFileCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.321 sec - in org.apache.hadoop.hdfs.TestFileCorruption Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.748 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Running org.apache.hadoop.hdfs.TestFetchImage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.757 sec - in org.apache.hadoop.hdfs.TestFetchImage Running org.apache.hadoop.hdfs.TestAclsEndToEnd Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.52 sec - in org.apache.hadoop.hdfs.TestAclsEndToEnd Running org.apache.hadoop.hdfs.TestErasureCodingPolicies Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.678 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicies Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.809 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 Running org.apache.hadoop.hdfs.TestPipelines Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.619 sec - in org.apache.hadoop.hdfs.TestPipelines Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.956 sec - in org.apache.hadoop.hdfs.TestSeekBug Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.256 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.643 sec - in org.apache.hadoop.hdfs.TestDisableConnCache Running org.apache.hadoop.hdfs.TestDataTransferProtocol Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.614 sec - in org.apache.hadoop.hdfs.TestDataTransferProtocol Running org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.17 sec - in org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.583 sec - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.591 sec - in org.apache.hadoop.hdfs.TestFileAppend Running org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.33 sec - in org.apache.hadoop.hdfs.TestBlockReaderLocalLegacy Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 276.62 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestKeyProviderCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.399 sec - in org.apache.hadoop.hdfs.TestKeyProviderCache Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 136.312 sec - in org.apache.hadoop.hdfs.TestHDFSFileSystemContract Running org.apache.hadoop.hdfs.TestGetFileChecksum Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.025 sec - in org.apache.hadoop.hdfs.TestGetFileChecksum Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.694 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200 Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 144.42 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.876 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160 Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.925 sec - in org.apache.hadoop.hdfs.TestDFSMkdirs Running org.apache.hadoop.hdfs.TestSafeModeWithStripedFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.341 sec - in org.apache.hadoop.hdfs.TestSafeModeWithStripedFile Running org.apache.hadoop.hdfs.TestHFlush Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.627 sec - in org.apache.hadoop.hdfs.TestHFlush Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.791 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090 Running org.apache.hadoop.hdfs.TestParallelReadUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.055 sec - in org.apache.hadoop.hdfs.TestParallelReadUtil Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.84 sec - in org.apache.hadoop.hdfs.TestLargeBlock Running org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.012 sec - in org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.83 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitRead Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.681 sec - in org.apache.hadoop.hdfs.TestDFSRollback Running org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.45 sec - in org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage Running org.apache.hadoop.hdfs.TestGetBlocks Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.063 sec - in org.apache.hadoop.hdfs.TestGetBlocks Running org.apache.hadoop.hdfs.TestQuota Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.822 sec - in org.apache.hadoop.hdfs.TestQuota Running org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 337.753 sec - in org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding Running org.apache.hadoop.hdfs.TestFileCreationClient Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.8 sec - in org.apache.hadoop.hdfs.TestFileCreationClient Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.7 sec - in org.apache.hadoop.hdfs.TestMiniDFSCluster Running org.apache.hadoop.hdfs.TestDFSConfigKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.565 sec - in org.apache.hadoop.hdfs.TestDFSConfigKeys Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.669 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.3 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 241.152 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110 Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.211 sec - in org.apache.hadoop.hdfs.TestDatanodeConfig Running org.apache.hadoop.hdfs.TestFileAppend4 Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.568 sec - in org.apache.hadoop.hdfs.TestFileAppend4 Running org.apache.hadoop.hdfs.TestDecommission Tests run: 18, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 206.324 sec - in org.apache.hadoop.hdfs.TestDecommission Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.049 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStream Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.621 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStream Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 79.503 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Running org.apache.hadoop.hdfs.TestErasureCodingPolicyWithSnapshot Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.18 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicyWithSnapshot Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.925 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestWriteRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.462 sec - in org.apache.hadoop.hdfs.TestWriteRead Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.121 sec - in org.apache.hadoop.hdfs.TestFileCreationEmpty Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.775 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 Running org.apache.hadoop.hdfs.TestDFSPermission Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.867 sec - in org.apache.hadoop.hdfs.TestDFSPermission Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.923 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestFSInputChecker Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.167 sec - in org.apache.hadoop.hdfs.TestFSInputChecker Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.651 sec - in org.apache.hadoop.hdfs.TestDFSClientFailover Running org.apache.hadoop.hdfs.TestDFSClientSocketSize Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.005 sec - in org.apache.hadoop.hdfs.TestDFSClientSocketSize Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.547 sec - in org.apache.hadoop.hdfs.TestAbandonBlock Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.193 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestParallelRead Results : Failed tests: TestDataNodeVolumeFailure.testUnderReplicationAfterVolFailure:398 There is no under replicated block after volume failure TestNamenodeCapacityReport.testXceiverCount:280->checkClusterHealth:320 expected:<14.0> but was:<15.0> TestNameNodeMetadataConsistency.testGenerationStampInFuture:125 expected:<18> but was:<0> Tests in error: TestDirectoryScanner.testThrottling:580->createFile:104->Object.wait:503->Object.wait:-2 » TestNNHandlesCombinedBlockReport>BlockReportTestBase.testOneReplicaRbwReportArrivesAfterBlockCompleted:624 » TestNodeCount.testNodeCount:130->checkTimeout:146->checkTimeout:152 Timeout Ti... TestEditLogTailer.testNN1TriggersLogRolls:114->testStandbyTriggersLogRolls:145->waitForLogRollInSharedDir:166 » Timeout Tests run: 2516, Failures: 3, Errors: 4, Skipped: 7 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [10:07 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 05:11 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.259 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:22 h [INFO] Finished at: 2015-11-09T12:18:14+00:00 [INFO] Final Memory: 71M/894M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Stream Closed -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating MAPREDUCE-5763
