See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2375/changes>
Changes: [kasha] YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha) [cmccabe] HADOOP-12447. Clean up some htrace integration issues (cmccabe) [cmccabe] Add HADOOP-12447 to CHANGES.txt [wheat9] HDFS-9165. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. ------------------------------------------ [...truncated 7231 lines...] Running org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.433 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestSafeMode Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.265 sec - in org.apache.hadoop.hdfs.TestSafeMode Running org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.818 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.198 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.49 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.415 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.775 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr Running org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.175 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Running org.apache.hadoop.hdfs.tools.TestGetConf Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.328 sec - in org.apache.hadoop.hdfs.tools.TestGetConf Running org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.339 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdminMiniCluster Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.829 sec - in org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Running org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.321 sec - in org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Running org.apache.hadoop.hdfs.tools.TestGetGroups Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.126 sec - in org.apache.hadoop.hdfs.tools.TestGetGroups Running org.apache.hadoop.hdfs.tools.TestDebugAdmin Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.025 sec - in org.apache.hadoop.hdfs.tools.TestDebugAdmin Running org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.67 sec - in org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Running org.apache.hadoop.hdfs.tools.TestDFSAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.693 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdmin Running org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.932 sec - in org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.557 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.218 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestDFSRename Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.734 sec - in org.apache.hadoop.hdfs.TestDFSRename Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.028 sec - in org.apache.hadoop.hdfs.TestLargeBlock Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.856 sec - in org.apache.hadoop.hdfs.TestDatanodeConfig Running org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.459 sec - in org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.523 sec - in org.apache.hadoop.hdfs.TestFileAppend2 Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.652 sec - in org.apache.hadoop.hdfs.protocolPB.TestPBHelper Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.28 sec - in org.apache.hadoop.hdfs.TestSetrepIncreasing Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 153.542 sec - in org.apache.hadoop.hdfs.TestDFSClientRetries Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 37, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.749 sec - in org.apache.hadoop.hdfs.TestBlockReaderLocal Running org.apache.hadoop.hdfs.TestHdfsAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.142 sec - in org.apache.hadoop.hdfs.TestHdfsAdmin Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.278 sec - in org.apache.hadoop.hdfs.TestDataTransferKeepalive Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.813 sec - in org.apache.hadoop.hdfs.TestEncryptedTransfer Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.49 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.976 sec - in org.apache.hadoop.hdfs.TestHDFSFileSystemContract Running org.apache.hadoop.hdfs.TestHFlush Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.398 sec - in org.apache.hadoop.hdfs.TestHFlush Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.745 sec - in org.apache.hadoop.hdfs.TestDisableConnCache Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.243 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.178 sec - in org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.759 sec - in org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.724 sec - in org.apache.hadoop.hdfs.TestDatanodeReport Running org.apache.hadoop.hdfs.TestBlockReaderFactory Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.402 sec - in org.apache.hadoop.hdfs.TestBlockReaderFactory Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.012 sec - in org.apache.hadoop.hdfs.TestMiniDFSCluster Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.65 sec - in org.apache.hadoop.hdfs.TestBlocksScheduledCounter Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.131 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestSnapshotCommands Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.57 sec - in org.apache.hadoop.hdfs.TestSnapshotCommands Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.387 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitRead Running org.apache.hadoop.hdfs.TestDFSPermission Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.275 sec - in org.apache.hadoop.hdfs.TestDFSPermission Running org.apache.hadoop.hdfs.TestParallelRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.545 sec - in org.apache.hadoop.hdfs.TestParallelRead Running org.apache.hadoop.hdfs.TestRollingUpgradeRollback Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.397 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeRollback Running org.apache.hadoop.hdfs.TestDFSConfigKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.223 sec - in org.apache.hadoop.hdfs.TestDFSConfigKeys Running org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.251 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Running org.apache.hadoop.hdfs.TestDFSUtil Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.595 sec - in org.apache.hadoop.hdfs.TestDFSUtil Running org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.454 sec - in org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Running org.apache.hadoop.hdfs.TestExternalBlockReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.591 sec - in org.apache.hadoop.hdfs.TestExternalBlockReader Running org.apache.hadoop.hdfs.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.569 sec - in org.apache.hadoop.hdfs.TestDeprecatedKeys Running org.apache.hadoop.hdfs.TestGetBlocks Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.752 sec - in org.apache.hadoop.hdfs.TestGetBlocks Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.417 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestParallelReadUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.039 sec - in org.apache.hadoop.hdfs.TestParallelReadUtil Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitShm Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.58 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitShm Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.042 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.38 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.038 sec - in org.apache.hadoop.hdfs.TestMultiThreadedHflush Running org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.673 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.638 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestRemoteBlockReader2 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.628 sec - in org.apache.hadoop.hdfs.TestRemoteBlockReader2 Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.046 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Running org.apache.hadoop.hdfs.TestReplication Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.712 sec - in org.apache.hadoop.hdfs.TestReplication Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.622 sec - in org.apache.hadoop.hdfs.TestFileAppend Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.638 sec - in org.apache.hadoop.hdfs.TestDistributedFileSystem Running org.apache.hadoop.hdfs.TestClientBlockVerification Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.206 sec - in org.apache.hadoop.hdfs.TestClientBlockVerification Running org.apache.hadoop.hdfs.TestReservedRawPaths Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.885 sec - in org.apache.hadoop.hdfs.TestReservedRawPaths Running org.apache.hadoop.hdfs.TestMissingBlocksAlert Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.068 sec - in org.apache.hadoop.hdfs.TestMissingBlocksAlert Running org.apache.hadoop.hdfs.TestClose Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.548 sec - in org.apache.hadoop.hdfs.TestClose Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.928 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.358 sec - in org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.443 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.611 sec - in org.apache.hadoop.tracing.TestTraceAdmin Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.929 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Results : Failed tests: TestDirectoryScanner.testThrottling:613 Throttle is too permissive Tests run: 3685, Failures: 1, Errors: 0, Skipped: 16 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:18 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:47 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.077 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:50 h [INFO] Finished at: 2015-09-29T20:45:49+00:00 [INFO] Final Memory: 56M/762M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2342 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 4798225 bytes Compression is 0.0% Took 2.4 sec Recording test results Updating HDFS-9165 Updating HADOOP-12447 Updating YARN-4066
