See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/374/changes>
Changes:
[cnauroth] HADOOP-12413. AccessControlList should avoid calling getGroupNames
in isUserInList with empty groups. Contributed by Zhihai Xu.
[wangda] YARN-3717. Expose app/am/queue's node-label-expression to RM web UI /
CLI / REST-API. (Naganarasimha G R via wangda)
[vinayakumarb] HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar
Avvaru)
[jlowe] MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be
consistent with tasks. Contributed by Naganarasimha G R
------------------------------------------
[...truncated 7385 lines...]
at
org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
at
org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:108)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:445)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby.forceBootstrap(TestBootstrapStandby.java:243)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby.assertSuccessfulBootstrapFromIndex(TestBootstrapStandby.java:249)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestBootstrapStandby.testOtherNodeNotActive(TestBootstrapStandby.java:212)
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 637.023 sec <<<
FAILURE! - in org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing
testNNClearsCommandsOnFailoverAfterStartup(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing)
Time elapsed: 10.212 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/io/retry/Idempotent
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:108)
at com.sun.proxy.$Proxy21.getDatanodeReport(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.datanodeReport(DFSClient.java:2122)
at
org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2385)
at
org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2428)
at
org.apache.hadoop.hdfs.MiniDFSCluster.restartNameNode(MiniDFSCluster.java:1976)
at
org.apache.hadoop.hdfs.MiniDFSCluster.restartNameNode(MiniDFSCluster.java:1951)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testNNClearsCommandsOnFailoverAfterStartup(TestDNFencing.java:209)
testRBWReportArrivesAfterEdits(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing)
Time elapsed: 6.671 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/util/IdentityHashStore$Visitor
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1058)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:276)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:271)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:284)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:771)
at
org.apache.hadoop.hdfs.DFSTestUtil.readFileBuffer(DFSTestUtil.java:340)
at org.apache.hadoop.hdfs.DFSTestUtil.readFile(DFSTestUtil.java:332)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testRBWReportArrivesAfterEdits(TestDNFencing.java:569)
testDnFencing(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing) Time
elapsed: 3.981 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/util/IdentityHashStore$Visitor
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1058)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:276)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:271)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:284)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:771)
at
org.apache.hadoop.hdfs.DFSTestUtil.getFirstBlock(DFSTestUtil.java:773)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testDnFencing(TestDNFencing.java:130)
testBlockReportsWhileFileBeingWritten(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing)
Time elapsed: 4.006 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/util/IdentityHashStore$Visitor
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1058)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:276)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:271)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:284)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:771)
at
org.apache.hadoop.hdfs.DFSTestUtil.readFileBuffer(DFSTestUtil.java:340)
at org.apache.hadoop.hdfs.DFSTestUtil.readFile(DFSTestUtil.java:332)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testBlockReportsWhileFileBeingWritten(TestDNFencing.java:412)
testNNClearsCommandsOnFailoverWithReplChanges(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing)
Time elapsed: 607.455 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/util/IdentityHashStore$Visitor
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1058)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:276)
at
org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:271)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:284)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:771)
at
org.apache.hadoop.hdfs.DFSTestUtil.readFileBuffer(DFSTestUtil.java:340)
at org.apache.hadoop.hdfs.DFSTestUtil.readFile(DFSTestUtil.java:332)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testNNClearsCommandsOnFailoverWithReplChanges(TestDNFencing.java:373)
testQueueingWithAppend(org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing)
Time elapsed: 4.344 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/io/retry/Idempotent
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:108)
at com.sun.proxy.$Proxy21.append(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.callAppend(DFSClient.java:1345)
at org.apache.hadoop.hdfs.DFSClient.append(DFSClient.java:1409)
at org.apache.hadoop.hdfs.DFSClient.append(DFSClient.java:1379)
at
org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:312)
at
org.apache.hadoop.hdfs.DistributedFileSystem$4.doCall(DistributedFileSystem.java:308)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.append(DistributedFileSystem.java:320)
at
org.apache.hadoop.hdfs.DistributedFileSystem.append(DistributedFileSystem.java:290)
at org.apache.hadoop.fs.FileSystem.append(FileSystem.java:1168)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencing.testQueueingWithAppend(TestDNFencing.java:454)
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.185 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running
org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.563 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.551 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.828 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.721 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.207 sec - in
org.apache.hadoop.hdfs.server.namenode.ha.TestHAMetrics
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m;
support was removed in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode
Results :
Failed tests:
TestLazyPersistReplicaPlacement.testSynchronousEviction:92->LazyPersistTestCase.verifyRamDiskJMXMetric:483
expected:<1> but was:<0>
TestLazyPersistLockedMemory.testReleaseOnEviction:122->LazyPersistTestCase.verifyRamDiskJMXMetric:483
expected:<1> but was:<0>
Tests in error:
TestBalancerWithMultipleNameNodes.testBalancer » Remote File /tmp.txt could
on...
TestBootstrapStandby.testSuccessfulBaseCase:109 » NoClassDefFound
org/apache/h...
TestBootstrapStandby.testStandbyDirsAlreadyExist:202->forceBootstrap:243 »
NoClassDefFound
TestBootstrapStandby.testDownloadingLaterCheckpoint:139->forceBootstrap:243 »
NoClassDefFound
TestBootstrapStandby.testOtherNodeNotActive:212->assertSuccessfulBootstrapFromIndex:249->forceBootstrap:243
» NoClassDefFound
TestDNFencing.testNNClearsCommandsOnFailoverAfterStartup:209 » NoClassDefFound
TestDNFencing.testRBWReportArrivesAfterEdits:569 » NoClassDefFound
org/apache/...
TestDNFencing.testDnFencing:130 » NoClassDefFound
org/apache/hadoop/util/Ident...
TestDNFencing.testBlockReportsWhileFileBeingWritten:412 » NoClassDefFound
org/...
TestDNFencing.testNNClearsCommandsOnFailoverWithReplChanges:373 »
NoClassDefFound
TestDNFencing.testQueueingWithAppend:454 » NoClassDefFound
org/apache/hadoop/i...
Tests run: 2070, Failures: 2, Errors: 11, Skipped: 6
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project
---
[INFO] Deleting
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project
---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable
package
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @
hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:18 min]
[INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:06 h]
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.082 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:09 h
[INFO] Finished at: 2015-09-15T22:12:15+00:00
[INFO] Final Memory: 88M/885M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on
project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked
VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs>
&& /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m
-XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter1161060351611079664.jar>
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire6268306301553226644tmp>
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_1787622658443975114951tmp>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #222
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 5375279 bytes
Compression is 0.0%
Took 6 sec
Recording test results
Updating HDFS-8953
Updating HADOOP-12413
Updating MAPREDUCE-6472
Updating YARN-3717
