See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2167/changes>
Changes: [jlowe] MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov. [jlowe] YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong [jlowe] YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula [rohithsharmaks] YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks) [rohithsharmaks] Move YARN-3790 from 2.7.1 to 2.8 in CHANGES.txt [jeagles] HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) [jeagles] YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles) [wang] HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. [benoy] HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. [devaraj] YARN-3826. Race condition in ResourceTrackerService leads to wrong [devaraj] YARN-3745. SerializedException should also try to instantiate internal ------------------------------------------ [...truncated 6657 lines...] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.716 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestSafeMode Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.855 sec - in org.apache.hadoop.hdfs.TestSafeMode Running org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.876 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.041 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.423 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Running org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.942 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Running org.apache.hadoop.hdfs.tools.TestGetConf Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.295 sec - in org.apache.hadoop.hdfs.tools.TestGetConf Running org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.367 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.445 sec - in org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Running org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.524 sec - in org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Running org.apache.hadoop.hdfs.tools.TestGetGroups Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.003 sec - in org.apache.hadoop.hdfs.tools.TestGetGroups Running org.apache.hadoop.hdfs.tools.TestDebugAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.048 sec - in org.apache.hadoop.hdfs.tools.TestDebugAdmin Running org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.401 sec - in org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Running org.apache.hadoop.hdfs.tools.TestDFSAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.459 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdmin Running org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.258 sec - in org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.175 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.886 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestDFSRename Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.319 sec - in org.apache.hadoop.hdfs.TestDFSRename Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.674 sec - in org.apache.hadoop.hdfs.TestLargeBlock Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.135 sec - in org.apache.hadoop.hdfs.TestDatanodeConfig Running org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.115 sec - in org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.61 sec - in org.apache.hadoop.hdfs.TestFileAppend2 Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.615 sec - in org.apache.hadoop.hdfs.protocolPB.TestPBHelper Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.801 sec - in org.apache.hadoop.hdfs.TestSetrepIncreasing Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.833 sec - in org.apache.hadoop.hdfs.TestDFSClientRetries Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 37, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.058 sec - in org.apache.hadoop.hdfs.TestBlockReaderLocal Running org.apache.hadoop.hdfs.TestHdfsAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.958 sec - in org.apache.hadoop.hdfs.TestHdfsAdmin Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.965 sec - in org.apache.hadoop.hdfs.TestDataTransferKeepalive Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 105.843 sec - in org.apache.hadoop.hdfs.TestEncryptedTransfer Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.925 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.854 sec - in org.apache.hadoop.hdfs.TestHDFSFileSystemContract Running org.apache.hadoop.hdfs.TestHFlush Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.693 sec - in org.apache.hadoop.hdfs.TestHFlush Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.407 sec - in org.apache.hadoop.hdfs.TestDisableConnCache Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.61 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.952 sec - in org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.565 sec - in org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.457 sec - in org.apache.hadoop.hdfs.TestDatanodeReport Running org.apache.hadoop.hdfs.TestBlockReaderFactory Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.309 sec - in org.apache.hadoop.hdfs.TestBlockReaderFactory Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.701 sec - in org.apache.hadoop.hdfs.TestMiniDFSCluster Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.314 sec - in org.apache.hadoop.hdfs.TestBlocksScheduledCounter Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.906 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestSnapshotCommands Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.149 sec - in org.apache.hadoop.hdfs.TestSnapshotCommands Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.467 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitRead Running org.apache.hadoop.hdfs.TestDFSPermission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.691 sec - in org.apache.hadoop.hdfs.TestDFSPermission Running org.apache.hadoop.hdfs.TestParallelRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.874 sec - in org.apache.hadoop.hdfs.TestParallelRead Running org.apache.hadoop.hdfs.TestRollingUpgradeRollback Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.255 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeRollback Running org.apache.hadoop.hdfs.TestDFSConfigKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.206 sec - in org.apache.hadoop.hdfs.TestDFSConfigKeys Running org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.169 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Running org.apache.hadoop.hdfs.TestDFSUtil Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.711 sec - in org.apache.hadoop.hdfs.TestDFSUtil Running org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.338 sec - in org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Running org.apache.hadoop.hdfs.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.56 sec - in org.apache.hadoop.hdfs.TestDeprecatedKeys Running org.apache.hadoop.hdfs.TestGetBlocks Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.127 sec - in org.apache.hadoop.hdfs.TestGetBlocks Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.184 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestParallelReadUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.039 sec - in org.apache.hadoop.hdfs.TestParallelReadUtil Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitShm Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.541 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitShm Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.958 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.082 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.785 sec - in org.apache.hadoop.hdfs.TestMultiThreadedHflush Running org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.382 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.563 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestRemoteBlockReader2 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.47 sec - in org.apache.hadoop.hdfs.TestRemoteBlockReader2 Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.286 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Running org.apache.hadoop.hdfs.TestReplication Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.254 sec - in org.apache.hadoop.hdfs.TestReplication Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.152 sec - in org.apache.hadoop.hdfs.TestFileAppend Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.959 sec - in org.apache.hadoop.hdfs.TestDistributedFileSystem Running org.apache.hadoop.hdfs.TestClientBlockVerification Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.919 sec - in org.apache.hadoop.hdfs.TestClientBlockVerification Running org.apache.hadoop.hdfs.TestReservedRawPaths Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.626 sec - in org.apache.hadoop.hdfs.TestReservedRawPaths Running org.apache.hadoop.hdfs.TestMissingBlocksAlert Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.702 sec - in org.apache.hadoop.hdfs.TestMissingBlocksAlert Running org.apache.hadoop.hdfs.TestClose Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.191 sec - in org.apache.hadoop.hdfs.TestClose Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.842 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.49 sec - in org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.174 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.208 sec - in org.apache.hadoop.tracing.TestTraceAdmin Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.538 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Results : Tests in error: TestAppendSnapshotTruncate.testAST:128 ยป IllegalState dir has ERROR Tests run: 3465, Failures: 0, Errors: 1, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 45.727 s] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:38 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.053 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:39 h [INFO] Finished at: 2015-06-25T15:33:23+00:00 [INFO] Final Memory: 55M/679M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2166 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 380916 bytes Compression is 0.0% Took 7.5 sec Recording test results Updating MAPREDUCE-6400 Updating HDFS-8646 Updating YARN-3826 Updating HADOOP-12049 Updating YARN-3809 Updating HADOOP-11958 Updating YARN-3790 Updating YARN-3832 Updating YARN-3745 Updating YARN-3360
