See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2117/changes>
Changes: [jlowe] YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith [wang] HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. [junping_du] YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula) [aw] HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) [xgong] YARN-2123. Progress bars in Web UI always at 100% due to non-US locale. [cmccabe] HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe) [aw] HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) [cmccabe] HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe) [aw] HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw) [jianhe] YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks [cmccabe] HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe) [xyao] HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) [rkanter] MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) [wheat9] HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu. [aw] HADOOP-11926. test-patch.sh mv does wrong math (aw) [cmccabe] HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) [xgong] YARN-3582. NPE in WebAppProxyServlet. Contributed by Jian He ------------------------------------------ [...truncated 6983 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.608 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Running org.apache.hadoop.fs.TestXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.089 sec - in org.apache.hadoop.fs.TestXAttr Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.508 sec - in org.apache.hadoop.fs.TestUnbuffer Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.555 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Running org.apache.hadoop.fs.TestEnhancedByteBufferAccess Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.385 sec - in org.apache.hadoop.fs.TestEnhancedByteBufferAccess Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.185 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.664 sec - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.905 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.678 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.989 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Running org.apache.hadoop.fs.TestVolumeId Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.209 sec - in org.apache.hadoop.fs.TestVolumeId Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.423 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.634 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.069 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.476 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.396 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.494 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.525 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.619 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.568 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.683 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.465 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.869 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.746 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.851 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.236 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.171 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.451 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.865 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.415 sec - in org.apache.hadoop.fs.permission.TestStickyBit Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.995 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.security.TestPermissionSymlinks Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.51 sec - in org.apache.hadoop.security.TestPermissionSymlinks Running org.apache.hadoop.security.TestRefreshUserMappings Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.797 sec - in org.apache.hadoop.security.TestRefreshUserMappings Running org.apache.hadoop.security.TestPermission Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.049 sec - in org.apache.hadoop.security.TestPermission Running org.apache.hadoop.tools.TestTools Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.431 sec - in org.apache.hadoop.tools.TestTools Running org.apache.hadoop.tools.TestJMXGet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.673 sec - in org.apache.hadoop.tools.TestJMXGet Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.326 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.139 sec <<< FAILURE! - in org.apache.hadoop.tracing.TestTraceAdmin testCreateAndDestroySpanReceiver(org.apache.hadoop.tracing.TestTraceAdmin) Time elapsed: 4.056 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException: Failed to load SpanReceiver org.apache.htrace.impl.LocalFileSpanReceiver at org.apache.hadoop.tracing.SpanReceiverHost.loadInstance(SpanReceiverHost.java:171) at org.apache.hadoop.tracing.SpanReceiverHost.addSpanReceiver(SpanReceiverHost.java:216) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addSpanReceiver(NameNodeRpcServer.java:2029) at org.apache.hadoop.tracing.TraceAdminProtocolServerSideTranslatorPB.addSpanReceiver(TraceAdminProtocolServerSideTranslatorPB.java:81) at org.apache.hadoop.tracing.TraceAdminPB$TraceAdminService$2.callBlockingMethod(TraceAdminPB.java:4580) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2174) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2170) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2168) at org.apache.hadoop.ipc.Client.call(Client.java:1492) at org.apache.hadoop.ipc.Client.call(Client.java:1423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy21.addSpanReceiver(Unknown Source) at org.apache.hadoop.tracing.TraceAdminProtocolTranslatorPB.addSpanReceiver(TraceAdminProtocolTranslatorPB.java:81) at org.apache.hadoop.tracing.TraceAdmin.addSpanReceiver(TraceAdmin.java:120) at org.apache.hadoop.tracing.TraceAdmin.run(TraceAdmin.java:182) at org.apache.hadoop.tracing.TestTraceAdmin.runTraceCommand(TestTraceAdmin.java:44) at org.apache.hadoop.tracing.TestTraceAdmin.testCreateAndDestroySpanReceiver(TestTraceAdmin.java:74) Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.577 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.976 sec - in org.apache.hadoop.net.TestNetworkTopology Running org.apache.hadoop.TestGenericRefresh Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.036 sec - in org.apache.hadoop.TestGenericRefresh Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.261 sec - in org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.683 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.985 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.157 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.918 sec - in org.apache.hadoop.cli.TestXAttrCLI Results : Tests in error: TestReplicationPolicyWithNodeGroup.<clinit>:77 » NoClassDefFound org/apache/ha... TestReplicationPolicyWithNodeGroup.testChooseTargetWithDependencies » NoClassDefFound TestReplicationPolicyWithNodeGroup.testChooseTarget1 » NoClassDefFound Could n... TestReplicationPolicyWithNodeGroup.testChooseTarget2 » NoClassDefFound Could n... TestReplicationPolicyWithNodeGroup.testChooseTarget3 » NoClassDefFound Could n... TestReplicationPolicyWithNodeGroup.testChooseTarget4 » NoClassDefFound Could n... TestReplicationPolicyWithNodeGroup.testChooseTarget5 » NoClassDefFound Could n... TestReplicationPolicyWithNodeGroup.testChooseTargetsOnBoundaryTopology » NoClassDefFound TestReplicationPolicyWithNodeGroup.testRereplicate1 » NoClassDefFound Could no... TestReplicationPolicyWithNodeGroup.testRereplicate2 » NoClassDefFound Could no... TestReplicationPolicyWithNodeGroup.testRereplicate3 » NoClassDefFound Could no... TestReplicationPolicyWithNodeGroup.testChooseMoreTargetsThanNodeGroups » NoClassDefFound TestReplicationPolicyWithNodeGroup.testChooseReplicaToDelete » NoClassDefFound TestFsck.testFsckForSnapshotFiles:1258 » Runtime java.util.zip.ZipException: i... TestFsck.testFsckMisPlacedReplicas:1097 » Runtime java.util.zip.ZipException: ... TestFsck.testBlockIdCKDecommission:1355 » Runtime java.util.zip.ZipException: ... TestFsck.testCorruptBlock:644 » Runtime java.util.zip.ZipException: invalid st... TestFsck.testFsckMove:324 » Runtime java.util.zip.ZipException: invalid stored... TestFsck.testFsckListCorruptFilesBlocks:908 » Runtime java.util.zip.ZipExcepti... TestFsck.testBlockIdCKCorruption:1439 » Runtime java.util.zip.ZipException: in... TestFsck.testFsckError:876 » Runtime java.util.zip.ZipException: invalid store... TestFsck.testFsckFileNotFound:1160 » NoClassDefFound org/apache/hadoop/ha/HASe... TestTraceAdmin.testCreateAndDestroySpanReceiver:74->runTraceCommand:44 » Remote Tests run: 3360, Failures: 0, Errors: 14, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 48.314 s] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 03:11 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.212 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:12 h [INFO] Finished at: 2015-05-06T15:32:15+00:00 [INFO] Final Memory: 76M/687M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There was a timeout or other error in the fork -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2116 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 362671 bytes Compression is 0.0% Took 15 sec Recording test results Updating YARN-3582 Updating YARN-3552 Updating HADOOP-11120 Updating HADOOP-11904 Updating HADOOP-11912 Updating HDFS-8314 Updating HADOOP-11911 Updating HADOOP-11926 Updating HADOOP-11917 Updating YARN-3396 Updating MAPREDUCE-6192 Updating HDFS-8305 Updating HDFS-7758 Updating HDFS-7847 Updating HDFS-8219 Updating YARN-2123 Updating YARN-3343