See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1394/changes>
Changes: [suresh] HADOOP-9553. TestAuthenticationToken fails on Windows. Contributed by Arpit Agarwal. [suresh] HADOOP-9556. disable HA tests on Windows that fail due to ZooKeeper client connection management bug. Contributed by Chris Nauroth. [atm] HDFS-4810. several HDFS HA tests have timeouts that are too short. Contributed by Chris Nauroth. [szetszwo] Combine CHANGES.HDFS-2802.txt to CHANGES.txt. [atm] HDFS-4661. A few little code cleanups of some HDFS-347-related code. Contributed by Colin Patrick McCabe. [szetszwo] svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802 for merging HDFS Snapshot feature branch. [tucu] YARN-598. Add virtual cores to queue metrics. (sandyr via tucu) [tucu] YARN-655. Fair scheduler metrics should subtract allocated memory from available memory. (sandyr via tucu) [tucu] YARN-637. FS: maxAssign is not honored. (kkambatl via tucu) [tucu] YARN-507. Add interface visibility and stability annotations to FS interfaces/classes. (kkambatl via tucu) [tucu] HADOOP-9550. Remove aspectj dependency. (kkambatl via tucu) [cdouglas] YARN-568. Add support for work preserving preemption to the FairScheduler. Contributed by Carlo Curino and Sandy Ryza [tucu] MAPREDUCE-4942. mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1. (rkanter via tucu) ------------------------------------------ [...truncated 10172 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.214 sec Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.69 sec Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.947 sec Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.48 sec Running org.apache.hadoop.hdfs.TestDecommission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 110.881 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.374 sec Running org.apache.hadoop.hdfs.TestFileStatus Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.276 sec Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.623 sec Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.851 sec Running org.apache.hadoop.hdfs.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.039 sec Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.9 sec Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.339 sec Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.011 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsTokens Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.794 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.287 sec Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.276 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.513 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.929 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.619 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.283 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.398 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.975 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 137.248 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.316 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.019 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.219 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.938 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.692 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.908 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.4 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.575 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.236 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.485 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 10, Failures: 0, Errors: 0, Skipped: 10, Time elapsed: 0.192 sec Running org.apache.hadoop.hdfs.TestFileInputStreamCache Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.208 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.86 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.256 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.818 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.006 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.582 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.777 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.276 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.726 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.207 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.429 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.28 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.TestPeerCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.317 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.378 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.814 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 98.31 sec Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.097 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.758 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.049 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.507 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.219 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.195 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 6, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 9.868 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.346 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.958 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.717 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.415 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.98 sec Running org.apache.hadoop.hdfs.util.TestBestEffortLongFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.197 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.187 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestDiff Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.449 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.222 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.682 sec Running org.apache.hadoop.hdfs.util.TestXMLUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.526 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.463 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.886 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.278 sec Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.13 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.251 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.214 sec Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.449 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.316 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.281 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.931 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.667 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.987 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.527 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.406 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.263 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.585 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.15 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.511 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.183 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.16 sec Running org.apache.hadoop.fs.TestVolumeId Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.066 sec Results : Failed tests: testReduceReplFactorDueToRejoinRespectsRackPolicy(org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks): Test resulted in an unexpected exit Tests run: 1879, Failures: 1, Errors: 0, Skipped: 34 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:29:03.874s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:29:04.646s [INFO] Finished at: Fri May 10 13:02:22 UTC 2013 [INFO] Final Memory: 17M/318M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/trunk/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Archiving artifacts Updating YARN-568 Updating YARN-598 Updating HDFS-4661 Updating HDFS-4810 Updating YARN-655 Updating HADOOP-9550 Updating HDFS-2802 Updating HADOOP-9553 Updating YARN-507 Updating YARN-637 Updating MAPREDUCE-4942 Updating HDFS-347 Updating HADOOP-9556