Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/ [Jul 15, 2016 9:04:48 AM] (naganarasimha_gr) YARN-5380. NMTimelinePublisher should use getMemorySize instead of [Jul 15, 2016 4:23:11 PM] (junping_du) YARN-5339. Passing file to -out for YARN log CLI doesnt give warning or [Jul 15, 2016 5:47:04 PM] (varunsaxena) YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. [Jul 15, 2016 6:23:32 PM] (junping_du) MAPREDUCE-6733. MapReduce JerseyTest tests failing with [Jul 15, 2016 6:40:12 PM] (wangda) YARN-4484. Available Resource calculation for a queue is not correct [Jul 15, 2016 6:42:44 PM] (aajisaka) HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed [Jul 15, 2016 8:30:03 PM] (rkanter) MAPREDUCE-6652. Add configuration property to prevent JHS from loading [Jul 15, 2016 8:41:26 PM] (rkanter) HADOOP-13254. Create framework for configurable disk checkers (yufeigu [Jul 15, 2016 9:28:53 PM] (jitendra) HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and [Jul 15, 2016 9:35:12 PM] (Arun Suresh) YARN=5181. ClusterNodeTracker: add method to get list of nodes matching [Jul 15, 2016 9:38:50 PM] (rchiang) YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred [Jul 15, 2016 11:01:16 PM] (ozawa) HADOOP-13298. Fix the leftover L&N files in [Jul 16, 2016 2:04:17 AM] (wang) Preparing for 3.0.0-alpha2 development [Jul 16, 2016 4:41:57 AM] (aajisaka) HDFS-10639. Fix typos in HDFSDiskbalancer.md. Contributed by Yiqun Lin. -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.TestFileCreationDelete hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.cli.TestLogsCLI hadoop.yarn.client.api.impl.TestYarnClient cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-compile-javac-root.txt [172K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/diff-javadoc-javadoc-root.txt [2.3M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [144K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/96/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HDFS-9277: - Thanks [~jojochuang] for reporting this. In our internal nightly test, this UT still fails intermittently. Reopen it for investigation. > IOException "Unable to load OAuth2 connection factory." in > TestWebHDFSOAuth2.listStatusReturnsAsExpected > > > Key: HDFS-9277 > URL: https://issues.apache.org/jira/browse/HDFS-9277 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Wei-Chiu Chuang > Attachments: HDFS-9277.001.patch > > > This test is failing consistently in Hadoop-hdfs-trunk and > Hadoop-hdfs-trunk-Java8 since September 22. > REGRESSION: > org.apache.hadoop.hdfs.web.TestWebHDFSOAuth2.listStatusReturnsAsExpected > Error Message: > Unable to load OAuth2 connection factory. > Stack Trace: > java.io.IOException: Unable to load OAuth2 connection factory. > at java.io.FileInputStream.open(Native Method) > at java.io.FileInputStream.(FileInputStream.java:146) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:164) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:81) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:215) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:131) > at > org.apache.hadoop.hdfs.web.URLConnectionFactory.newSslConnConfigurator(URLConnectionFactory.java:135) > at > org.apache.hadoop.hdfs.web.URLConnectionFactory.newOAuth2URLConnectionFactory(URLConnectionFactory.java:110) > at > org.apache.hadoop.hdfs.web.WebHdfsFileSystem.initialize(WebHdfsFileSystem.java:158) > at > org.apache.hadoop.hdfs.web.TestWebHDFSOAuth2.listStatusReturnsAsExpected(TestWebHDFSOAuth2.java:147) -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10641) Fix intermittently failing TestBlockManager#testBlockReportQueueing
Mingliang Liu created HDFS-10641:
Summary: Fix intermittently failing
TestBlockManager#testBlockReportQueueing
Key: HDFS-10641
URL: https://issues.apache.org/jira/browse/HDFS-10641
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs, test
Reporter: Mingliang Liu
See example failing [stack
trace|https://builds.apache.org/job/PreCommit-HADOOP-Build/9996/testReport/org.apache.hadoop.hdfs.server.blockmanagement/TestBlockManager/testBlockReportQueueing/].
h6. Stacktrace
{code}
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testBlockReportQueueing(TestBlockManager.java:1074)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas
Mingliang Liu created HDFS-10642:
Summary: Fix intermittently failing UT
TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas
Key: HDFS-10642
URL: https://issues.apache.org/jira/browse/HDFS-10642
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode, test
Affects Versions: 3.0.0-alpha2
Reporter: Mingliang Liu
See [example stack trace |
https://builds.apache.org/job/PreCommit-HADOOP-Build/10001/testReport/org.apache.hadoop.hdfs.server.datanode.fsdataset.impl/TestLazyPersistReplicaRecovery/testDnRestartWithSavedReplicas/].
h6. Error Message
{code}
Expected: is
but: was
{code}
h6. Stacktrace
{code}
java.lang.AssertionError:
Expected: is
but: was
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:865)
at org.junit.Assert.assertThat(Assert.java:832)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.LazyPersistTestCase.ensureFileReplicasOnStorageType(LazyPersistTestCase.java:141)
at
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery.testDnRestartWithSavedReplicas(TestLazyPersistReplicaRecovery.java:53)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10643) HDFS namenode should always use service user (hdfs) to generateEncryptedKey
Xiaoyu Yao created HDFS-10643: - Summary: HDFS namenode should always use service user (hdfs) to generateEncryptedKey Key: HDFS-10643 URL: https://issues.apache.org/jira/browse/HDFS-10643 Project: Hadoop HDFS Issue Type: Bug Components: encryption, namenode Affects Versions: 2.6.0 Reporter: Xiaoyu Yao Assignee: Xiaoyu Yao KMSClientProvider is designed to be shared by different KMS clients. When HDFS Namenode as KMS client talks to KMS to generateEncryptedKey for new file creation from proxy user (hive, oozie), the proxyuser handling for KMSClientProvider in this case is unnecessary, which cause 1) an extra proxy user configuration allowing hdfs user to proxy its clients and 2) KMS acls to allow non-hdfs user for GENERATE_EEK operation. This ticket is opened to always use HDFS namenode login user (hdfs) when talking to KMS to generateEncryptedKey for new file creation. This way, we have a more secure KMS based HDFS encryption (we can set kms-acls to allow only hdfs user for GENERATE_EEK) with less configuration hassle for KMS to allow hdfs to proxy other users. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10644) Fix intermittently failing TestDFSUpgradeWithHA#testRollbackWithJournalNodes
Mingliang Liu created HDFS-10644:
Summary: Fix intermittently failing
TestDFSUpgradeWithHA#testRollbackWithJournalNodes
Key: HDFS-10644
URL: https://issues.apache.org/jira/browse/HDFS-10644
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Affects Versions: 3.0.0-alpha2
Reporter: Mingliang Liu
See [example stack trace |
https://builds.apache.org/job/PreCommit-HADOOP-Build/9996/testReport/org.apache.hadoop.hdfs.server.namenode.ha/TestDFSUpgradeWithHA/testRollbackWithJournalNodes/]
along with stand output/error.
h6. Stacktrace
{code}
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA.testRollbackWithJournalNodes(TestDFSUpgradeWithHA.java:687)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
