See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/433/changes>
Changes: [yliu] HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) ------------------------------------------ [...truncated 7890 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec - in org.apache.hadoop.fs.TestXAttr Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.751 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.234 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.773 sec - in org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.768 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.878 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.993 sec - in org.apache.hadoop.fs.permission.TestStickyBit Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.699 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.603 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.902 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.098 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.303 sec <<< FAILURE! - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Time elapsed: 2.303 sec <<< ERROR! java.lang.NoClassDefFoundError: org/apache/hadoop/security/authentication/server/AuthenticationFilter at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:360) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:447) at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:340) at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:114) at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:290) at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:126) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:771) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:625) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:833) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:812) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1213) at org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:976) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:887) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:819) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:478) at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:437) at org.apache.hadoop.fs.contract.hdfs.HDFSContract.createCluster(HDFSContract.java:58) at org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen.createCluster(TestHDFSContractOpen.java:36) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.013 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.345 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.568 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 63.845 sec <<< FAILURE! - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Time elapsed: 63.845 sec <<< ERROR! java.lang.NoClassDefFoundError: org/apache/hadoop/security/proto/SecurityProtos$GetDelegationTokenRequestProto at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:360) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2688) at java.lang.Class.privateGetPublicMethods(Class.java:2814) at java.lang.Class.privateGetPublicMethods(Class.java:2824) at java.lang.Class.getMethods(Class.java:1602) at sun.misc.ProxyGenerator.generateClassFile(ProxyGenerator.java:451) at sun.misc.ProxyGenerator.generateProxyClass(ProxyGenerator.java:339) at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:638) at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:556) at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230) at java.lang.reflect.WeakCache.get(WeakCache.java:127) at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:418) at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:717) at org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:104) at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:581) at org.apache.hadoop.hdfs.NameNodeProxiesClient.createNonHAProxyWithClientProtocol(NameNodeProxiesClient.java:345) at org.apache.hadoop.hdfs.NameNodeProxiesClient.createProxyWithClientProtocol(NameNodeProxiesClient.java:131) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:337) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:280) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:270) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:261) at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2382) at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2428) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1607) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:840) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:478) at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:437) at org.apache.hadoop.fs.contract.hdfs.HDFSContract.createCluster(HDFSContract.java:58) at org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate.createCluster(TestHDFSContractCreate.java:33) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.445 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.27 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.468 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.209 sec - in org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestGlobPaths Tests run: 36, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 6.072 sec - in org.apache.hadoop.fs.TestGlobPaths Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsDisable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.116 sec - in org.apache.hadoop.fs.TestSymlinkHdfsDisable Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 71, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.498 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.752 sec - in org.apache.hadoop.fs.TestUnbuffer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.TestGenericRefresh Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.46 sec - in org.apache.hadoop.TestGenericRefresh Results : Failed tests: TestDirectoryScanner.testThrottling:677 Scanner took too long to shutdown TestSeveralNameNodes.testCircularLinkedListWrites:90 Some writers didn't complete in expected runtime! Current writer state:[Circular Writer: directory: /test-1 target length: 50 current item: 37 done: false , Circular Writer: directory: /test-2 target length: 50 current item: 50 done: false ] expected:<0> but was:<2> Tests in error: TestDFSUpgradeFromImage.testUpgradeFromRel1BBWImage:622->upgradeAndVerify:600->verifyFileSystem:228->verifyDir:213->dfsOpenFileWithRetries:177 » IO TestHDFSContractOpen.createCluster:36 » NoClassDefFound org/apache/hadoop/secu... TestHDFSContractCreate.createCluster:33 » NoClassDefFound org/apache/hadoop/se... Tests run: 3675, Failures: 2, Errors: 3, Skipped: 16 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [04:01 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 03:03 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.063 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:07 h [INFO] Finished at: 2015-09-29T12:00:12+00:00 [INFO] Final Memory: 55M/574M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #222 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 5857013 bytes Compression is 0.0% Took 3.9 sec Recording test results Updating HDFS-8859