See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2215/changes>
Changes: [kasha] MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) [xyao] HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao) [szetszwo] HDFS-8824. Do not use small blocks for balancing the cluster. [jing9] HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. [kasha] MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) ------------------------------------------ [...truncated 7173 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.645 sec - in org.apache.hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.042 sec - in org.apache.hadoop.hdfs.TestDatanodeReport Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.661 sec - in org.apache.hadoop.hdfs.protocolPB.TestPBHelper Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.665 sec - in org.apache.hadoop.hdfs.TestEncryptedTransfer Running org.apache.hadoop.hdfs.TestPipelines Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.06 sec - in org.apache.hadoop.hdfs.TestPipelines Running org.apache.hadoop.hdfs.TestHttpPolicy Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.586 sec - in org.apache.hadoop.hdfs.TestHttpPolicy Running org.apache.hadoop.hdfs.TestEncryptionZonesWithHA Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.628 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithHA Running org.apache.hadoop.hdfs.TestWriteRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.108 sec - in org.apache.hadoop.hdfs.TestWriteRead Running org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.236 sec - in org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.692 sec - in org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Running org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.664 sec <<< FAILURE! - in org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure testReplaceDatanodeOnFailure(org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure) Time elapsed: 11.851 sec <<< FAILURE! java.lang.AssertionError: expected:<3> but was:<2> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:555) at org.junit.Assert.assertEquals(Assert.java:542) at org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure$SlowWriter.checkReplication(TestReplaceDatanodeOnFailure.java:235) at org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure.testReplaceDatanodeOnFailure(TestReplaceDatanodeOnFailure.java:154) Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.824 sec - in org.apache.hadoop.hdfs.TestPersistBlocks Running org.apache.hadoop.hdfs.TestFSInputChecker Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.008 sec - in org.apache.hadoop.hdfs.TestFSInputChecker Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.05 sec - in org.apache.hadoop.fs.TestFcHdfsSetUMask Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.22 sec - in org.apache.hadoop.fs.TestFcHdfsPermission Running org.apache.hadoop.fs.TestGlobPaths Tests run: 36, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 5.619 sec - in org.apache.hadoop.fs.TestGlobPaths Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.994 sec - in org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Running org.apache.hadoop.fs.TestSymlinkHdfsDisable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.647 sec - in org.apache.hadoop.fs.TestSymlinkHdfsDisable Running org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Tests run: 74, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.164 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.084 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Running org.apache.hadoop.fs.TestXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 sec - in org.apache.hadoop.fs.TestXAttr Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.811 sec - in org.apache.hadoop.fs.TestUnbuffer Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.033 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Running org.apache.hadoop.fs.TestEnhancedByteBufferAccess Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.644 sec - in org.apache.hadoop.fs.TestEnhancedByteBufferAccess Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.188 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.068 sec - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.195 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.714 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Running org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.097 sec - in org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.161 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Running org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.511 sec - in org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Running org.apache.hadoop.fs.TestVolumeId Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.207 sec - in org.apache.hadoop.fs.TestVolumeId Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.761 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.37 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.798 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.933 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.182 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.279 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.2 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.644 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.253 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.461 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 71, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.971 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.489 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.242 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.048 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.33 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.547 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.738 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.216 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.411 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.497 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.637 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.22 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.554 sec - in org.apache.hadoop.fs.permission.TestStickyBit Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.653 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.security.TestPermissionSymlinks Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.732 sec - in org.apache.hadoop.security.TestPermissionSymlinks Running org.apache.hadoop.security.TestRefreshUserMappings Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.975 sec - in org.apache.hadoop.security.TestRefreshUserMappings Running org.apache.hadoop.security.TestPermission Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.241 sec - in org.apache.hadoop.security.TestPermission Running org.apache.hadoop.tools.TestTools Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.53 sec - in org.apache.hadoop.tools.TestTools Running org.apache.hadoop.tools.TestJMXGet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.93 sec - in org.apache.hadoop.tools.TestJMXGet Running org.apache.hadoop.tools.TestHdfsConfigFields Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.7 sec - in org.apache.hadoop.tools.TestHdfsConfigFields Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.735 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.475 sec - in org.apache.hadoop.tracing.TestTraceAdmin Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.704 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.373 sec - in org.apache.hadoop.net.TestNetworkTopology Running org.apache.hadoop.TestGenericRefresh Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.447 sec - in org.apache.hadoop.TestGenericRefresh Running org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.947 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.176 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.861 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.006 sec - in org.apache.hadoop.cli.TestXAttrCLI Results : Failed tests: TestReplaceDatanodeOnFailure.testReplaceDatanodeOnFailure:154 expected:<3> but was:<2> Tests in error: TestRollingUpgradeDowngrade.testDowngrade ยป Unexpected exception, expected<ja... Tests run: 3633, Failures: 1, Errors: 1, Skipped: 16 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:19 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:55 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.071 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:58 h [INFO] Finished at: 2015-08-15T14:33:41+00:00 [INFO] Final Memory: 64M/871M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There was a timeout or other error in the fork -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2199 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 3862101 bytes Compression is 0.0% Took 2.7 sec Recording test results Updating MAPREDUCE-6439 Updating HDFS-8565 Updating HDFS-8891 Updating MAPREDUCE-5817 Updating HDFS-8824