See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2636/changes>
Changes: [umamahesh] HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via ------------------------------------------ [...truncated 15842 lines...] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.151 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.94 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.433 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Running org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.325 sec - in org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks Running org.apache.hadoop.hdfs.tools.TestGetConf Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.897 sec - in org.apache.hadoop.hdfs.tools.TestGetConf Running org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.452 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.503 sec - in org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Running org.apache.hadoop.hdfs.tools.TestDFSAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.435 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdmin Running org.apache.hadoop.hdfs.tools.TestDebugAdmin Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.949 sec - in org.apache.hadoop.hdfs.tools.TestDebugAdmin Running org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.863 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Running org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.853 sec - in org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Running org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.542 sec - in org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Running org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.109 sec - in org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Running org.apache.hadoop.hdfs.tools.TestGetGroups Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.949 sec - in org.apache.hadoop.hdfs.tools.TestGetGroups Running org.apache.hadoop.hdfs.TestGetFileChecksum Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.337 sec - in org.apache.hadoop.hdfs.TestGetFileChecksum Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 132.904 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.091 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Running org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 188.237 sec - in org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 81.552 sec <<< FAILURE! - in org.apache.hadoop.hdfs.TestPersistBlocks TestRestartDfsWithFlush(org.apache.hadoop.hdfs.TestPersistBlocks) Time elapsed: 9.086 sec <<< ERROR! java.io.EOFException: End of File Exception between local host is: "asf909.gq1.ygridcore.net/67.195.81.153"; destination host is: "localhost":41006; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:765) at org.apache.hadoop.ipc.Client.call(Client.java:1452) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230) at com.sun.proxy.$Proxy19.addBlock(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:404) at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:255) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) at com.sun.proxy.$Proxy20.addBlock(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream.addBlock(DFSOutputStream.java:917) at org.apache.hadoop.hdfs.DataStreamer.locateFollowingBlock(DataStreamer.java:1685) at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1495) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:595) Caused by: java.io.EOFException: null at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1110) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1005) Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 44.063 sec - in org.apache.hadoop.hdfs.TestAppendDifferentChecksum Running org.apache.hadoop.hdfs.TestHttpPolicy Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.437 sec - in org.apache.hadoop.hdfs.TestHttpPolicy Running org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.5 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.611 sec - in org.apache.hadoop.hdfs.TestHDFSTrash Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 116.426 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestErasureCodingPolicies Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.558 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicies Running org.apache.hadoop.hdfs.TestRollingUpgrade Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 146.159 sec - in org.apache.hadoop.hdfs.TestRollingUpgrade Running org.apache.hadoop.hdfs.TestFetchImage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.597 sec - in org.apache.hadoop.hdfs.TestFetchImage Running org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.687 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestReplication Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.842 sec - in org.apache.hadoop.hdfs.TestReplication Running org.apache.hadoop.hdfs.TestQuota Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.275 sec - in org.apache.hadoop.hdfs.TestQuota Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.405 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.549 sec - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Running org.apache.hadoop.hdfs.TestDFSStripedOutputStream Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.99 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStream Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.306 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Running org.apache.hadoop.hdfs.TestWriteStripedFileWithFailure Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.202 sec - in org.apache.hadoop.hdfs.TestWriteStripedFileWithFailure Running org.apache.hadoop.hdfs.TestRecoverStripedFile Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 122.511 sec - in org.apache.hadoop.hdfs.TestRecoverStripedFile Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.659 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.659 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Running org.apache.hadoop.hdfs.TestDFSStripedInputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.841 sec - in org.apache.hadoop.hdfs.TestDFSStripedInputStream Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.286 sec - in org.apache.hadoop.hdfs.TestDisableConnCache Running org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.818 sec - in org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.575 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Running org.apache.hadoop.hdfs.qjournal.server.TestJournal Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.012 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournal Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.186 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.689 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.186 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Running org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.512 sec - in org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Running org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.938 sec - in org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Running org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.784 sec - in org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Running org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 374.224 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.742 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Running org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.887 sec - in org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Running org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.617 sec - in org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Running org.apache.hadoop.hdfs.TestConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.614 sec - in org.apache.hadoop.hdfs.TestConnCache Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.156 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestDFSInputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.676 sec - in org.apache.hadoop.hdfs.TestDFSInputStream Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.003 sec - in org.apache.hadoop.hdfs.TestFileAppend Running org.apache.hadoop.hdfs.TestFileAppend3 Results : Failed tests: TestDataNodeVolumeFailure.testUnderReplicationAfterVolFailure:398 There is no under replicated block after volume failure TestBlockReplacement.testDeletedBlockWhenAddBlockIsInEdit:435 The block should be only on 1 datanode expected:<1> but was:<2> TestBlockManager.testBlockReportQueueing:926 null TestFileTruncate.testTruncateWithDataNodesShutdownImmediately:866->checkBlockRecovery:1169->checkBlockRecovery:1174->checkBlockRecovery:1190 inode should complete in ~30000 ms. Expected: is <true> but: was <false> TestMissingBlocksAlert.testMissingBlocksAlert:119 expected:<2> but was:<4> TestSaslDataTransfer.testIntegrity:90->doTest:185 expected:<3> but was:<1> Tests in error: TestBlockScanner.testVolumeIteratorWithCaching:250->testVolumeIteratorImpl:174->Object.wait:503->Object.wait:-2 » TestDataNodeMultipleRegistrations.testClusterIdMismatchAtStartupWithHA:259 » ... TestDirectoryScanner.testThrottling:580->createFile:104->Object.wait:503->Object.wait:-2 » TestFileTruncate.testTruncateWithDataNodesRestart:698 » Timeout Timed out wait... TestDeleteRace.testDeleteAndCommitBlockSynchonizationRaceNoSnapshot:350->testDeleteAndCommitBlockSynchronizationRace:317 » TestSecureNameNode.testName:65 » IO Failed on local exception: java.io.IOExcep... TestSaslDataTransfer.testNoSaslAndSecurePortsIgnored:164->startCluster:196 » ... TestDFSStripedOutputStreamWithFailure170>TestDFSStripedOutputStreamWithFailure$TestBase.test9:498->TestDFSStripedOutputStreamWithFailure$TestBase.run:486 » TestPersistBlocks.TestRestartDfsWithFlush » EOF End of File Exception between ... Tests run: 3184, Failures: 6, Errors: 9, Skipped: 8 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [08:52 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 06:49 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 3.134 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:58 h [INFO] Finished at: 2015-12-17T11:37:54+00:00 [INFO] Final Memory: 74M/701M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Stream Closed -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results
