See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2370/changes>
Changes: [kihwal] HDFS-9106. Transfer failure during pipeline recovery causes permanent write failures. Contributed by Kihwal Lee. ------------------------------------------ [...truncated 14467 lines...] TestBalancerWithNodeGroup.testBalancerWithRackLocality:230 » NoSuchMethod org.... TestBalancerWithNodeGroup.testBalancerWithNodeGroup:289 » NoSuchMethod org.apa... TestBalancerWithNodeGroup.testBalancerEndInNoMoveProgress:343 » NoSuchMethod o... TestBalancerWithHANameNodes.testBalancerWithHANameNodes:72 » NoClassDefFound o... TestStorageMover.testMigrateFileToArchival:482 » NoSuchMethod org.apache.hadoo... TestStorageMover.testMoveSpecificPaths:512 » NoSuchMethod org.apache.hadoop.tr... TestStorageMover.testNoSpaceArchive:718 » NoSuchMethod org.apache.hadoop.traci... TestStorageMover.testNoSpaceDisk:660 » NoSuchMethod org.apache.hadoop.tracing.... TestStorageMover.testMigrateOpenFileToArchival:544 » NoSuchMethod org.apache.h... TestStorageMover.testHotWarmColdDirs:605 » NoSuchMethod org.apache.hadoop.trac... TestMover.testMoveWhenStoragePolicyNotSatisfying:353 » NoSuchMethod org.apache... TestMover.testScheduleBlockWithinSameNode:117 » NoSuchMethod org.apache.hadoop... TestMover.testMoverFailedRetry:384 » NoSuchMethod org.apache.hadoop.tracing.Tr... TestMover.testMoverCliWithHAConf:206 » NoClassDefFound org/apache/htrace/Trace TestMover.testTwoReplicaSameStorageTypeShouldNotSelect:306 » NoSuchMethod org.... TestMover.testMoverCliWithFederationHA:276 » NoClassDefFound org/apache/htrace... TestMover.testScheduleSameBlock:82 » NoSuchMethod org.apache.hadoop.tracing.Tr... TestMover.testMoverCli:173 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils... TestMover.testMoverCliWithFederation:228 » NoSuchMethod org.apache.hadoop.trac... TestDatanodeStartupFixesLegacyStorageIDs.testUpgradeFrom22via26FixesStorageIDs:125->runLayoutUpgradeTest:70->upgradeAndVerify:103 » NoSuchMethod TestDatanodeStartupFixesLegacyStorageIDs.testUpgradeFrom26PreservesStorageIDs:136->runLayoutUpgradeTest:70->upgradeAndVerify:103 » NoSuchMethod TestDatanodeStartupFixesLegacyStorageIDs.testUpgradeFrom22FixesStorageIDs:115->runLayoutUpgradeTest:70->upgradeAndVerify:103 » NoSuchMethod TestDatanodeReport.testDatanodeReport:55 » NoSuchMethod org.apache.hadoop.trac... TestEncryptedTransfer.testEncryptedWriteWithTwoDns:491->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testEncryptedWriteWithOneDn:486->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testEncryptedAppend:544 » NoSuchMethod org.apache.hadoop... TestEncryptedTransfer.testEncryptedWriteWithMultipleDns:496->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testLongLivedWriteClientAfterRestart:408 » NoSuchMethod ... TestEncryptedTransfer.testEncryptedAppendRequiringBlockTransfer:570 » NoSuchMethod TestEncryptedTransfer.testEncryptedReadAfterNameNodeRestart:267 » NoSuchMethod TestEncryptedTransfer.testClientThatDoesNotSupportEncryption:309 » NoSuchMethod TestEncryptedTransfer.testLongLivedClient:437 » NoSuchMethod org.apache.hadoop... TestEncryptedTransfer.testEncryptedReadWithAES:214 » NoSuchMethod org.apache.h... TestEncryptedTransfer.testEncryptedReadWithRC4:157 » NoSuchMethod org.apache.h... TestEncryptedTransfer.testLongLivedReadClientAfterRestart:364 » NoSuchMethod o... TestEncryptedTransfer.testEncryptedRead:104 » NoSuchMethod org.apache.hadoop.t... TestEncryptedTransfer.testEncryptedWriteWithTwoDns:491->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testEncryptedWriteWithOneDn:486->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testEncryptedAppend:544 » NoSuchMethod org.apache.hadoop... TestEncryptedTransfer.testEncryptedWriteWithMultipleDns:496->testEncryptedWrite:505 » NoSuchMethod TestEncryptedTransfer.testLongLivedWriteClientAfterRestart:408 » NoSuchMethod ... TestEncryptedTransfer.testEncryptedAppendRequiringBlockTransfer:570 » NoSuchMethod TestEncryptedTransfer.testEncryptedReadAfterNameNodeRestart:267 » NoSuchMethod TestEncryptedTransfer.testClientThatDoesNotSupportEncryption:309 » NoSuchMethod TestEncryptedTransfer.testLongLivedClient:437 » NoSuchMethod org.apache.hadoop... TestEncryptedTransfer.testEncryptedReadWithAES:214 » NoSuchMethod org.apache.h... TestEncryptedTransfer.testEncryptedReadWithRC4:157 » NoSuchMethod org.apache.h... TestEncryptedTransfer.testLongLivedReadClientAfterRestart:364 » NoSuchMethod o... TestEncryptedTransfer.testEncryptedRead:104 » NoSuchMethod org.apache.hadoop.t... TestPipelines.startUpCluster:63 » NoSuchMethod org.apache.hadoop.tracing.Trace... TestEncryptionZonesWithHA.setupCluster:67 » NoClassDefFound org/apache/htrace/... TestWriteRead.initJunitModeTest:77 » NoSuchMethod org.apache.hadoop.tracing.Tr... TestWriteRead.shutdown:89 NullPointer TestWriteRead.initJunitModeTest:77 » NoSuchMethod org.apache.hadoop.tracing.Tr... TestWriteRead.shutdown:89 NullPointer TestWriteRead.initJunitModeTest:77 » NoSuchMethod org.apache.hadoop.tracing.Tr... TestWriteRead.shutdown:89 NullPointer TestDFSInotifyEventInputStream.testBasic:94 » NoSuchMethod org.apache.hadoop.t... TestDFSInotifyEventInputStream.testReadEventsWithTimeout:494 » NoSuchMethod or... TestDFSInotifyEventInputStream.testNNFailover:417 » NoSuchMethod org.apache.ha... TestDFSInotifyEventInputStream.testTwoActiveNNs:449 » NoSuchMethod org.apache.... TestClientProtocolForPipelineRecovery.testGetNewStamp:45 » NoSuchMethod org.ap... TestClientProtocolForPipelineRecovery.testPipelineRecoveryForLastBlock:136 » NoSuchMethod TestClientProtocolForPipelineRecovery.testPipelineRecoveryOnRestartFailure:214 » NoSuchMethod TestClientProtocolForPipelineRecovery.testPipelineRecoveryOnOOB:176 » NoSuchMethod TestReplaceDatanodeOnFailure.testReplaceDatanodeOnFailure:122 » NoSuchMethod o... TestReplaceDatanodeOnFailure.testBestEffort:296 » NoSuchMethod org.apache.hado... TestReplaceDatanodeOnFailure.testAppend:244 » NoSuchMethod org.apache.hadoop.t... TestPersistBlocks.testEarlierVersionEditLog:337 » NoSuchMethod org.apache.hado... TestPersistBlocks.testRestartDfsWithAbandonedBlock:163 » NoSuchMethod org.apac... TestPersistBlocks.testRestartWithAppend:273 » NoSuchMethod org.apache.hadoop.t... TestPersistBlocks.testRestartWithPartialBlockHflushed:224 » NoSuchMethod org.a... TestPersistBlocks.TestRestartDfsWithFlush:80->testRestartDfs:104 » NoSuchMethod TestFSInputChecker.testFSInputChecker:326 » NoSuchMethod org.apache.hadoop.tra... TestFcHdfsSetUMask.clusterSetupAtBegining:90 » NoSuchMethod org.apache.hadoop.... TestFcHdfsSetUMask.ClusterShutdownAtEnd:99 NullPointer TestFcHdfsPermission.clusterSetupAtBegining:58 » NoSuchMethod org.apache.hadoo... TestFcHdfsPermission.ClusterShutdownAtEnd:68 NullPointer TestGlobPaths.setUp:71 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils.wra... TestLoadGenerator.testLoadGenerator:152 » NoSuchMethod org.apache.hadoop.traci... TestSymlinkHdfsDisable.testSymlinkHdfsDisable:41 » NoSuchMethod org.apache.had... TestSymlinkHdfsFileSystem>TestSymlinkHdfs.beforeClassSetup:92 » NoSuchMethod o... TestSymlinkHdfsFileSystem>TestSymlinkHdfs.afterClassTeardown:99 » NullPointer TestUrlStreamHandler.testFileUrls:125 » NoClassDefFound org/apache/htrace/Trac... TestUrlStreamHandler.testDfsUrls:56 » NoSuchMethod org.apache.hadoop.tracing.T... TestUnbuffer.testUnbufferClosesSockets:60 » NoSuchMethod org.apache.hadoop.tra... TestUnbuffer.testOpenManyFilesViaTcp:106 » NoSuchMethod org.apache.hadoop.trac... TestFcHdfsCreateMkdir.clusterSetupAtBegining:51 » NoSuchMethod org.apache.hado... TestFcHdfsCreateMkdir.ClusterShutdownAtEnd:61 NullPointer TestEnhancedByteBufferAccess.testZeroCopyReadsNoFallback:250 » NoSuchMethod or... TestEnhancedByteBufferAccess.testShortZeroCopyReads:194 » NoSuchMethod org.apa... TestEnhancedByteBufferAccess.testFallbackRead:528 » NoSuchMethod org.apache.ha... TestEnhancedByteBufferAccess.testZeroCopyMmapCache:341 » NoSuchMethod org.apac... TestEnhancedByteBufferAccess.testHdfsFallbackReads:444 » NoSuchMethod org.apac... TestEnhancedByteBufferAccess.testClientMmapDisable:730 » NoSuchMethod org.apac... TestEnhancedByteBufferAccess.testZeroCopyReads:147 » NoSuchMethod org.apache.h... TestEnhancedByteBufferAccess.testZeroCopyReadOfCachedData:608 » NoSuchMethod o... TestHDFSFileContextMainOperations.clusterSetupAtBegining:59 » NoSuchMethod org... TestHdfsTextCommand.setUp:54 » NoSuchMethod org.apache.hadoop.tracing.TraceUti... TestSWebHdfsFileContextMainOperations.clusterSetupAtBeginning:83 » NoSuchMethod TestResolveHdfsSymlink.setUp:61 » NoSuchMethod org.apache.hadoop.tracing.Trace... TestWebHdfsFileContextMainOperations.clusterSetupAtBeginning:77 » NoSuchMethod TestViewFsWithAcls.clusterSetupAtBeginning:67 » NoSuchMethod org.apache.hadoop... TestViewFsWithAcls.ClusterShutdownAtEnd:79 NullPointer TestViewFsFileStatusHdfs.clusterSetupAtBegining:65 » NoSuchMethod org.apache.h... TestViewFsFileStatusHdfs.cleanup:121 NullPointer TestViewFileSystemHdfs.clusterSetupAtBegining:65 » NoSuchMethod org.apache.had... TestViewFileSystemHdfs.ClusterShutdownAtEnd:91 NullPointer TestViewFsWithXAttrs.clusterSetupAtBeginning:61 » NoSuchMethod org.apache.hado... TestViewFsWithXAttrs.ClusterShutdownAtEnd:73 NullPointer TestViewFsAtHdfsRoot.clusterSetupAtBegining:59 » NoSuchMethod org.apache.hadoo... TestViewFsAtHdfsRoot.ClusterShutdownAtEnd:67 NullPointer TestViewFsHdfs.clusterSetupAtBegining:56 » NoSuchMethod org.apache.hadoop.trac... TestViewFsHdfs.ClusterShutdownAtEnd:67 NullPointer TestViewFileSystemWithAcls.clusterSetupAtBeginning:67 » NoSuchMethod org.apach... TestViewFileSystemWithAcls.ClusterShutdownAtEnd:79 NullPointer TestViewFileSystemAtHdfsRoot.clusterSetupAtBegining:58 » NoSuchMethod org.apac... TestViewFileSystemWithXAttrs.clusterSetupAtBeginning:62 » NoSuchMethod org.apa... TestViewFileSystemWithXAttrs.ClusterShutdownAtEnd:74 NullPointer TestViewFsDefaultValue.clusterSetupAtBegining:82 » NoSuchMethod org.apache.had... TestViewFsDefaultValue.cleanup:166 NullPointer TestSymlinkHdfsFileContext>TestSymlinkHdfs.beforeClassSetup:92 » NoSuchMethod ... TestSymlinkHdfsFileContext>TestSymlinkHdfs.afterClassTeardown:99 » NullPointer TestHDFSContractDelete.createCluster:36 » NoSuchMethod org.apache.hadoop.traci... TestHDFSContractSetTimes.createCluster:33 » NoSuchMethod org.apache.hadoop.tra... TestHDFSContractMkdir.createCluster:36 » NoSuchMethod org.apache.hadoop.tracin... TestHDFSContractOpen.createCluster:36 » NoSuchMethod org.apache.hadoop.tracing... TestHDFSContractRootDirectory.createCluster:37 » NoSuchMethod org.apache.hadoo... TestHDFSContractAppend.createCluster:29 » NoSuchMethod org.apache.hadoop.traci... TestHDFSContractCreate.createCluster:33 » NoSuchMethod org.apache.hadoop.traci... TestHDFSContractSeek.createCluster:36 » NoSuchMethod org.apache.hadoop.tracing... TestHDFSContractRename.createCluster:33 » NoSuchMethod org.apache.hadoop.traci... TestHDFSContractGetFileStatus.createCluster:34 » NoSuchMethod org.apache.hadoo... TestHDFSContractConcat.createCluster:36 » NoSuchMethod org.apache.hadoop.traci... TestStickyBit.init:68->initCluster:72 » NoSuchMethod org.apache.hadoop.tracing... TestRefreshCallQueue.setUp:68 » NoClassDefFound org/apache/htrace/Trace TestPermissionSymlinks.beforeClassSetUp:78 » NoSuchMethod org.apache.hadoop.tr... TestRefreshUserMappings.setUp:94 » NoSuchMethod org.apache.hadoop.tracing.Trac... TestRefreshUserMappings.setUp:94 » NoSuchMethod org.apache.hadoop.tracing.Trac... TestPermission.testFilePermission:198 » NoSuchMethod org.apache.hadoop.tracing... TestPermission.testCreate:140 » NoSuchMethod org.apache.hadoop.tracing.TraceUt... TestTools.testDFSAdminInvalidUsageHelp:85 » NoClassDefFound org/apache/htrace/... TestJMXGet.testDataNode:146 » NoSuchMethod org.apache.hadoop.tracing.TraceUtil... TestJMXGet.tearDown:76 NullPointer TestJMXGet.testNameNode:93 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils... TestJMXGet.tearDown:76 NullPointer TestTracing.<clinit>:59 » NoClassDefFound org/apache/htrace/SpanReceiver TestTraceAdmin.testCreateAndDestroySpanReceiver:64 » NoSuchMethod org.apache.h... TestTracingShortCircuitLocalRead.testShortCircuitTraceHooks:67 » NoClassDefFound TestNetworkTopology.testInvalidNetworkTopologiesNotCachedInHdfs:321 » NoSuchMethod TestGenericRefresh.setUpBeforeClass:60 » NoSuchMethod org.apache.hadoop.tracin... TestHDFSCLI.setUp:56 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils.wrapH... TestHDFSCLI.tearDown:85->CLITestHelper.tearDown:125->CLITestHelper.displayResults:162->expandCommand:91 » NullPointer TestCacheAdminCLI.setUp:63 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils... TestAclCLI.setUp:40 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils.wrapHa... TestAclCLI.tearDown:49->CLITestHelper.tearDown:125->CLITestHelper.displayResults:162->expandCommand:66 » NullPointer TestCryptoAdminCLI.setUp:72 » NoClassDefFound org/apache/htrace/Trace TestCryptoAdminCLI.tearDown:94->CLITestHelper.tearDown:125->CLITestHelper.displayResults:162->expandCommand:115 » NullPointer TestXAttrCLI.setUp:49 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils.wrap... TestXAttrCLI.tearDown:75->CLITestHelper.tearDown:125->CLITestHelper.displayResults:162->expandCommand:81 » NullPointer TestDeleteCLI.setUp:47 » NoSuchMethod org.apache.hadoop.tracing.TraceUtils.wra... TestDeleteCLI.tearDown:66->CLITestHelper.tearDown:125->CLITestHelper.displayResults:162->expandCommand:77 » NullPointer Tests run: 3008, Failures: 14, Errors: 499, Skipped: 8 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:19 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:08 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.058 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:11 h [INFO] Finished at: 2015-09-28T22:30:13+00:00 [INFO] Final Memory: 55M/727M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs> && /home/jenkins/tools/java/jdk1.7.0_55/jre/bin/java -Xmx2048m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter5502500243650416394.jar> <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire1294589651704654788tmp> <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_3854681508992583445560tmp> [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2342 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 4798327 bytes Compression is 0.0% Took 1.9 sec Recording test results Updating HDFS-9106
