See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1145/changes>
Changes: [sseth] YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth) [suresh] HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. [tucu] MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu) [eli] HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe [atm] HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers. [suresh] Correcting the jira number back to HDFS-3834 from HDFS-3844. I should pay better attention. [suresh] Correcting the jira number from HDFS-3834 to HDFS-3844 for the commit 1377001 [suresh] HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao. [bobby] HADOOP-8725. MR is broken when security is off (daryn via bobby) [szetszwo] HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee ------------------------------------------ [...truncated 10928 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.359 sec Running org.apache.hadoop.hdfs.TestFSOutputSummer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.18 sec Running org.apache.hadoop.hdfs.TestSetrepDecreasing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.217 sec Running org.apache.hadoop.hdfs.TestHftpFileSystem Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.131 sec Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.056 sec Running org.apache.hadoop.hdfs.TestFSInputChecker Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.201 sec Running org.apache.hadoop.hdfs.TestHftpDelegationToken Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.589 sec <<< FAILURE! Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.185 sec Running org.apache.hadoop.hdfs.TestByteRangeInputStream Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.309 sec Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.063 sec Running org.apache.hadoop.hdfs.TestRenameWhileOpen Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.111 sec Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.43 sec Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.025 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.577 sec Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.108 sec Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec Running org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.44 sec Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.549 sec Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.356 sec Running org.apache.hadoop.hdfs.TestDecommission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.22 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.116 sec Running org.apache.hadoop.hdfs.TestFileStatus Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.961 sec Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.91 sec Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.572 sec Running org.apache.hadoop.hdfs.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.932 sec Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.988 sec Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.056 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.52 sec Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.74 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.39 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.655 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.154 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 110.757 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.041 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.289 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.025 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 146.391 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.152 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 116.935 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.954 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.472 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.048 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.529 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.804 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.031 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.577 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.168 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.468 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.853 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.135 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.708 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.097 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.857 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.928 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.313 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.924 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.102 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.631 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.061 sec Running org.apache.hadoop.hdfs.TestParallelLocalRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.403 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.147 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.843 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 698.663 sec <<< FAILURE! Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.507 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.759 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.927 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.189 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.075 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.005 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.584 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.327 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.185 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.395 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.421 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.673 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.093 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.163 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.569 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.489 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.523 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.859 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.879 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.519 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.989 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.371 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.07 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.712 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.921 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.891 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.235 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.185 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.731 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.024 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.766 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.024 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.131 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 59, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.792 sec Results : Failed tests: testHdfsDelegationToken(org.apache.hadoop.hdfs.TestHftpDelegationToken): wrong tokens in user expected:<2> but was:<1> Tests in error: testBlockCorruptionRecoveryPolicy1(org.apache.hadoop.hdfs.TestDatanodeBlockScanner): Timed out waiting for corrupt replicas. Waiting for 1, but only found 0 Tests run: 1480, Failures: 1, Errors: 1, Skipped: 4 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:34:02.044s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:34:02.810s [INFO] Finished at: Sat Aug 25 13:07:40 UTC 2012 [INFO] Final Memory: 33M/304M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-hdfs: ExecutionException; nested exception is java.util.concurrent.ExecutionException: org.apache.maven.surefire.booter.SurefireBooterForkException: Error occurred in starting fork, check output in log -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException Build step 'Execute shell' marked build as failure Archiving artifacts Updating HDFS-3177 Updating HDFS-3844 Updating YARN-39 Updating HDFS-3834 Updating HDFS-3678 Updating HDFS-3731 Updating HADOOP-8725 Updating MAPREDUCE-4408