See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1139/changes>
Changes: [szetszwo] HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee [suresh] HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao ------------------------------------------ [...truncated 10924 lines...] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.532 sec Running org.apache.hadoop.hdfs.TestDefaultNameNodePort Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.363 sec Running org.apache.hadoop.hdfs.TestFSOutputSummer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.214 sec Running org.apache.hadoop.hdfs.TestSetrepDecreasing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.167 sec Running org.apache.hadoop.hdfs.TestHftpFileSystem Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.147 sec Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.358 sec Running org.apache.hadoop.hdfs.TestFSInputChecker Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.063 sec Running org.apache.hadoop.hdfs.TestHftpDelegationToken Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.627 sec Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.332 sec Running org.apache.hadoop.hdfs.TestByteRangeInputStream Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.31 sec Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.996 sec Running org.apache.hadoop.hdfs.TestRenameWhileOpen Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.939 sec Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.433 sec Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 134.974 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.692 sec Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.68 sec Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec Running org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.675 sec Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.769 sec Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.429 sec Running org.apache.hadoop.hdfs.TestDecommission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 121.319 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.085 sec Running org.apache.hadoop.hdfs.TestFileStatus Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.093 sec Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.927 sec Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.844 sec Running org.apache.hadoop.hdfs.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.933 sec Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.82 sec Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.224 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.451 sec Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.735 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.39 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.441 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.154 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.416 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.05 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.288 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.114 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 145.231 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.171 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.195 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.938 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.344 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.964 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.75 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.197 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.661 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.803 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.211 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.9 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.643 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.494 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.375 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.21 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.328 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.047 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.185 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.077 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.098 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.211 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.969 sec Running org.apache.hadoop.hdfs.TestParallelLocalRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.335 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.13 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.851 sec Running org.apache.hadoop.hdfs.TestFileCreationNamenodeRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.486 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 117.468 sec <<< FAILURE! Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.119 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.766 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.737 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.391 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.034 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.89 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.956 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.4 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.11 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.57 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.318 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.559 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.167 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.096 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.163 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.591 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.55 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.491 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.861 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.155 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.501 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.889 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.174 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.293 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.736 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.032 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.895 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.101 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.017 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.089 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.105 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.084 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.843 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.126 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 59, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.584 sec Results : Failed tests: testReduceReplFactorDueToRejoinRespectsRackPolicy(org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks): Test resulted in an unexpected exit testNodeDecomissionRespectsRackPolicy(org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks): Test resulted in an unexpected exit testNodeDecomissionWithOverreplicationRespectsRackPolicy(org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks): Test resulted in an unexpected exit Tests in error: testBlockCorruptionRecoveryPolicy2(org.apache.hadoop.hdfs.TestDatanodeBlockScanner): Timed out waiting for corrupt replicas. Waiting for 2, but only found 0 Tests run: 1476, Failures: 3, Errors: 1, Skipped: 5 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:14:20.580s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:14:22.249s [INFO] Finished at: Sun Aug 19 12:47:30 UTC 2012 [INFO] Final Memory: 33M/273M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-hdfs: ExecutionException; nested exception is java.util.concurrent.ExecutionException: org.apache.maven.surefire.booter.SurefireBooterForkException: Error occurred in starting fork, check output in log -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException Build step 'Execute shell' marked build as failure Archiving artifacts Updating HADOOP-8240 Updating HDFS-3816