See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/137/changes>
Changes: [kihwal] HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp. [ozawa] HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula. [ozawa] MAPREDUCE-6294. Remove an extra parameter described in Javadoc of TockenCache. Contributed by Brahma Reddy Battula. [cnauroth] HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. [Arun Suresh] HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh) [arp] HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao) [harsh] MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula. ------------------------------------------ [...truncated 10193 lines...] at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2140) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2136) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2134) at org.apache.hadoop.ipc.Client.call(Client.java:1492) at org.apache.hadoop.ipc.Client.call(Client.java:1423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy20.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getContentSummary(ClientNamenodeProtocolTranslatorPB.java:803) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101) at com.sun.proxy.$Proxy21.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getContentSummary(DFSClient.java:3043) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:726) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:722) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:733) at org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateAppend(TestQuotaByStorageType.java:161) testQuotaByStorageTypeWithFileCreateDelete(org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType) Time elapsed: 1.046 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException: org/apache/hadoop/fs/ContentSummary$Builder at org.apache.hadoop.hdfs.server.namenode.INode.computeAndConvertContentSummary(INode.java:447) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getContentSummaryInt(FSDirStatAndListingOp.java:500) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getContentSummary(FSDirStatAndListingOp.java:139) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getContentSummary(FSNamesystem.java:3892) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getContentSummary(NameNodeRpcServer.java:1193) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getContentSummary(ClientNamenodeProtocolServerSideTranslatorPB.java:875) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:973) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2140) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2136) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2134) at org.apache.hadoop.ipc.Client.call(Client.java:1492) at org.apache.hadoop.ipc.Client.call(Client.java:1423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy20.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getContentSummary(ClientNamenodeProtocolTranslatorPB.java:803) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101) at com.sun.proxy.$Proxy21.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getContentSummary(DFSClient.java:3043) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:726) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:722) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:733) at org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateDelete(TestQuotaByStorageType.java:202) testQuotaByStorageTypeWithFileCreateRename(org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType) Time elapsed: 1.084 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException: org/apache/hadoop/fs/ContentSummary$Builder at org.apache.hadoop.hdfs.server.namenode.INode.computeAndConvertContentSummary(INode.java:447) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getContentSummaryInt(FSDirStatAndListingOp.java:500) at org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getContentSummary(FSDirStatAndListingOp.java:139) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getContentSummary(FSNamesystem.java:3892) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getContentSummary(NameNodeRpcServer.java:1193) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getContentSummary(ClientNamenodeProtocolServerSideTranslatorPB.java:875) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:973) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2140) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2136) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2134) at org.apache.hadoop.ipc.Client.call(Client.java:1492) at org.apache.hadoop.ipc.Client.call(Client.java:1423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy20.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getContentSummary(ClientNamenodeProtocolTranslatorPB.java:803) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101) at com.sun.proxy.$Proxy21.getContentSummary(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getContentSummary(DFSClient.java:3043) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:726) at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:722) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:733) at org.apache.hadoop.hdfs.server.namenode.TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateRename(TestQuotaByStorageType.java:248) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.261 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSEditLogLoader Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSNamesystem Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.725 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSNamesystem Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestCommitBlockSynchronization Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.968 sec - in org.apache.hadoop.hdfs.server.namenode.TestCommitBlockSynchronization Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.638 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFsLimits Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.172 sec - in org.apache.hadoop.hdfs.server.namenode.TestFsLimits Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl Results : Tests in error: TestEncryptedTransfer.testEncryptedAppend:551->writeTestDataToFile:605 » Remote TestEncryptedTransfer.testLongLivedWriteClientAfterRestart:421->writeTestDataToFile:605 » Remote TestEncryptedTransfer.testEncryptedAppendRequiringBlockTransfer:589->writeTestDataToFile:605 » Remote TestEncryptedTransfer.testEncryptedAppend:551->writeTestDataToFile:605 » Remote TestEncryptedTransfer.testLongLivedWriteClientAfterRestart:421->writeTestDataToFile:605 » Remote TestEncryptedTransfer.testEncryptedAppendRequiringBlockTransfer:589->writeTestDataToFile:605 » Remote TestGetFileChecksum.testGetFileChecksum:72->testGetFileChecksum:60 » Remote or... TestDFSPermission.testPermissionChecking:412->testPermissionCheckingPerUser:548->testStats:888 » Remote TestBlockReaderLocalLegacy.testBlockReaderLocalLegacyWithAppend:199 » Remote o... TestFileAppend3.testTC2:169 » Remote org/apache/hadoop/fs/ContentSummary$Build... TestFileAppend3.testTC5:229 » Remote org/apache/hadoop/fs/ContentSummary$Build... TestFileAppend3.testTC7:341->testTC7:330 » Remote org/apache/hadoop/fs/Content... TestFileAppend3.testTC12:450->testTC12:431 » Remote org/apache/hadoop/fs/Conte... TestFileAppend3.testAppendToPartialChunk:595->testAppendToPartialChunk:482 » Remote TestDistributedFileSystem.testStatistics:442 » Remote org/apache/hadoop/fs/Con... TestHdfsAdmin.testHdfsAdminSetQuota:64 » Remote org/apache/hadoop/fs/ContentSu... TestAddBlock.testAddBlockUC:133 » Remote org/apache/hadoop/fs/ContentSummary$B... TestSnapshotDiffReport.testDiffReportWithRenameAndAppend:485 » Remote org/apac... TestSnapshotFileLength.testSnapshotfileLength:112 » Remote org/apache/hadoop/f... TestSnapshotFileLength.testSnapshotFileLengthWithCatCommand:183 » Remote org/a... TestINodeFileUnderConstructionWithSnapshot.testGetBlockLocations:239->appendFileWithoutClosing:133 » Remote TestNameEditsConfigs.testNameEditsConfigs:179->checkFile:99 » Remote org/apach... TestNameEditsConfigs.testNameEditsConfigsFailure:448->checkFile:99 » Remote or... TestFSImageWithSnapshot.testLoadImageWithAppending:403->appendFileWithoutClosing:133 » Remote TestFSImageWithSnapshot.testSaveLoadImageWithAppending:349->appendFileWithoutClosing:133 » Remote TestNamenodeRetryCache.testAppend:235 » NoClassDefFound org/apache/hadoop/fs/C... TestSnapshotPathINodes.testSnapshotPathINodesAfterModification:384 » Remote or... TestSnapshotPathINodes.testSnapshotPathINodesAfterDeletion:286 » Snapshot The ... TestHDFSConcat.testConcatWithQuotaIncrease:460 » Remote org/apache/hadoop/fs/C... TestHDFSConcat.testConcatWithQuotaDecrease:429 » Remote org/apache/hadoop/fs/C... TestHDFSConcat.testConcat:154 » Remote org/apache/hadoop/fs/ContentSummary$Bui... TestDNFencing.testQueueingWithAppend:458 » Remote org/apache/hadoop/fs/Content... TestQuotasWithHA.testQuotasTrackedOnStandby:97 » NoClassDefFound org/apache/ha... TestHAAppend.testMultipleAppendsDuringCatchupTailing:99 » Remote org/apache/ha... TestHASafeMode.testAppendWhileInSafeMode:425 » Remote org/apache/hadoop/fs/Con... TestRetryCacheWithHA.testAppend:1136->testClientRetryWithFailover:1293->Object.wait:502->Object.wait:-2 » TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateTruncate:631 » Remote TestQuotaByStorageType.testQuotaByStorageTypeWithSnapshot:573 » Remote org/apa... TestQuotaByStorageType.testContentSummaryWithoutStoragePolicy:779 » Remote org... TestQuotaByStorageType.testContentSummaryWithoutQuotaByStorageType:756 » Remote TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateAppend:161 » Remote TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateDelete:202 » Remote TestQuotaByStorageType.testQuotaByStorageTypeWithFileCreateRename:248 » Remote Tests run: 2090, Failures: 0, Errors: 43, Skipped: 13 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is missing, no dependency information available [WARNING] Failed to retrieve plugin descriptor for org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in http://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 01:14 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 1.925 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:14 h [INFO] Finished at: 2015-03-28T12:48:59+00:00 [INFO] Final Memory: 59M/246M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs> && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter9092782731554127802.jar> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire1137952542295105439tmp> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_731861070078652389917tmp> [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating HADOOP-11639 Updating MAPREDUCE-6291 Updating HDFS-8004 Updating HADOOP-11760 Updating HDFS-7700 Updating MAPREDUCE-6294 Updating HDFS-7990