See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/203/changes>
Changes: [kasha] YARN-3467. Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI. (Anubhav Dhoot via kasha) [zjshen] YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong. [xgong] YARN-2900. Application (Attempt and Container) Not Found in AHS results [xgong] Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" ------------------------------------------ [...truncated 7278 lines...] Running org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.75 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.512 sec - in org.apache.hadoop.hdfs.TestLargeBlock Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.391 sec - in org.apache.hadoop.hdfs.TestHDFSTrash Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.583 sec - in org.apache.hadoop.hdfs.TestClientReportBadBlock Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestWriteRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.66 sec - in org.apache.hadoop.hdfs.TestWriteRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.735 sec - in org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestBalancerBandwidth Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.759 sec - in org.apache.hadoop.hdfs.TestBalancerBandwidth Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.141 sec - in org.apache.hadoop.hdfs.TestDFSUpgrade Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.676 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.611 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestBlockReaderFactory Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.505 sec - in org.apache.hadoop.hdfs.TestBlockReaderFactory Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.client.impl.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.238 sec - in org.apache.hadoop.hdfs.client.impl.TestLeaseRenewer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.977 sec - in org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.427 sec - in org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.379 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.server.TestJournal Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.445 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournal Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.008 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.889 sec - in org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 142.441 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.3 sec - in org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.117 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.288 sec - in org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.245 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.191 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.611 sec - in org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.919 sec - in org.apache.hadoop.hdfs.TestFileCreationEmpty Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.319 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.964 sec - in org.apache.hadoop.hdfs.TestDataTransferKeepalive Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestModTime Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.788 sec - in org.apache.hadoop.hdfs.TestModTime Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.337 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestLease Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.475 sec - in org.apache.hadoop.hdfs.TestLease Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.963 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.514 sec - in org.apache.hadoop.hdfs.TestDeprecatedKeys Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFSOutputSummer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.487 sec - in org.apache.hadoop.hdfs.TestFSOutputSummer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.149 sec - in org.apache.hadoop.hdfs.TestRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.98 sec - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.989 sec - in org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.945 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestGetBlocks Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.807 sec - in org.apache.hadoop.hdfs.TestGetBlocks Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDataTransferProtocol Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.082 sec - in org.apache.hadoop.hdfs.TestDataTransferProtocol Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.329 sec - in org.apache.hadoop.hdfs.TestReadWhileWriting Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestKeyProviderCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.508 sec - in org.apache.hadoop.hdfs.TestKeyProviderCache Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.209 sec - in org.apache.hadoop.net.TestNetworkTopology Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.55 sec - in org.apache.hadoop.tracing.TestTraceAdmin Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.696 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 5.038 sec <<< FAILURE! - in org.apache.hadoop.tracing.TestTracing testTracing(org.apache.hadoop.tracing.TestTracing) Time elapsed: 4.581 sec <<< ERROR! java.lang.IndexOutOfBoundsException: Index: 0 at java.util.Collections$EmptyList.get(Collections.java:4513) at org.apache.hadoop.tracing.TestTracing.writeWithTracing(TestTracing.java:128) at org.apache.hadoop.tracing.TestTracing.testTracing(TestTracing.java:67) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.092 sec - in org.apache.hadoop.TestRefreshCallQueue Results : Failed tests: TestDNFencing.testQueueingWithAppend:463 expected:<21> but was:<20> TestDataNodeMetrics.testDataNodeTimeSpend:288 null Tests in error: TestWebHDFS.testNamenodeRestart:235 » NoClassDefFound org/apache/hadoop/io/ret... TestWebHDFS.testLargeDirectory:263 » NoClassDefFound org/apache/hadoop/fs/FSDa... TestWebHDFS.testLargeFile:111->largeFileTest:137 » NoClassDefFound org/apache/... TestWebHDFS.testWebHdfsOffsetAndLength:537 » NoClassDefFound org/apache/hadoop... TestTracing.testTracing:67->writeWithTracing:128 » IndexOutOfBounds Index: 0 Tests run: 3439, Failures: 2, Errors: 5, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 47.893 s] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:47 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.067 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:47 h [INFO] Finished at: 2015-05-31T14:22:20+00:00 [INFO] Final Memory: 52M/251M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #202 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 804909 bytes Compression is 0.0% Took 11 sec Recording test results Updating YARN-2900 Updating YARN-3467 Updating YARN-1462