See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1402/changes>
Changes: [jlowe] MAPREDUCE-4927. Historyserver 500 error due to NPE when accessing specific counters page for failed job. Contributed by Ashwin Shankar [vinodkv] MAPREDUCE-5234. Change mapred.TaskReport and mapreduce.TaskReport for binary compatibility with mapred in 1.x but incompatible with 0.23.x. Contributed by Mayank Bansal. ------------------------------------------ [...truncated 10159 lines...] Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 154.566 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.631 sec Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.008 sec Running org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.35 sec Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.051 sec Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.698 sec Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.942 sec Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.246 sec Running org.apache.hadoop.hdfs.TestDecommission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 119.964 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.533 sec Running org.apache.hadoop.hdfs.TestFileStatus Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.511 sec Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.65 sec Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.22 sec Running org.apache.hadoop.hdfs.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.091 sec Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.003 sec Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.387 sec Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.04 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsTokens Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.833 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.617 sec Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.353 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.511 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.819 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.164 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.085 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.293 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsTimeouts Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.98 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.399 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.955 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.433 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.242 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.824 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.104 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.768 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.518 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.024 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.097 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.794 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.388 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.489 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 10, Failures: 0, Errors: 0, Skipped: 10, Time elapsed: 0.196 sec Running org.apache.hadoop.hdfs.TestFileInputStreamCache Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.208 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.738 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.355 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.949 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.945 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.713 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.5 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.53 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.617 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.153 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.169 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadUnCached Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.TestPeerCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.316 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.355 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.893 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.895 sec Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.771 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.771 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.094 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.655 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.199 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.142 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 6, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 9.569 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.083 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.308 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.657 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.135 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.775 sec Running org.apache.hadoop.hdfs.util.TestBestEffortLongFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.169 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestDiff Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.416 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.681 sec Running org.apache.hadoop.hdfs.util.TestXMLUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.783 sec Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Tests run: 4, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 11, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.624 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.888 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.69 sec Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.131 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.306 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.194 sec Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.454 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.529 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.552 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.846 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.753 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.869 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.035 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.389 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.06 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.612 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.292 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.547 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.733 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.565 sec Running org.apache.hadoop.fs.TestVolumeId Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.066 sec Results : Failed tests: testReduceReplFactorDueToRejoinRespectsRackPolicy(org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks): Test resulted in an unexpected exit Tests run: 1895, Failures: 1, Errors: 0, Skipped: 36 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:28:06.737s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:28:07.511s [INFO] Finished at: Sat May 18 13:01:24 UTC 2013 [INFO] Final Memory: 26M/488M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/trunk/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Archiving artifacts Updating MAPREDUCE-4927 Updating MAPREDUCE-5234