Re: Jenkins patch-compile fails on trunk
Hi YARN-5868 is created to handle this issue. Thanks Sunil On Fri, Nov 11, 2016 at 6:09 AM Wangda Tan wrote: > This looks like bug caused by npm, looking into it now. > > Thanks, > Wangda > > On Thu, Nov 10, 2016 at 4:00 PM, Zhe Zhang wrote: > > > https://builds.apache.org/job/PreCommit-HDFS-Build/17517/ > > artifact/patchprocess/patch-compile-root.txt > > > > Looks related to yarn-ui? The HDFS-10872 patch doesn't touch YARN, but > the > > patch-compile failed at YARN. > > > > Thanks, > > Zhe > > >
[jira] [Created] (HADOOP-13808) replace `Can't get Master Kerberos principal` message with useful information about principal and configuration item
Steve Loughran created HADOOP-13808: --- Summary: replace `Can't get Master Kerberos principal` message with useful information about principal and configuration item Key: HADOOP-13808 URL: https://issues.apache.org/jira/browse/HADOOP-13808 Project: Hadoop Common Issue Type: Sub-task Reporter: Steve Loughran Clients get the `Can't get Master Kerberos principal` error message when their config doesn't identify the principal for a service. This message is fairly useless as # it doesn't identify the service for which a principal is sought # it doesn't identify the configuration property looked for # it doesn't provide any guidance of how to fix it As a result, anyone seeing this doesn't have a clue what to do. I propose # naming the principal sought, e.g. "namenode", "YARN RM" # naming the configuration item looked for # adding a link to a wiki page covering the problem KDiag should scan through the common set of principals if it doesn't already -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/ [Nov 10, 2016 7:44:02 AM] (kasha) YARN-5453. FairScheduler#update may skip update demand resource of child [Nov 10, 2016 11:21:33 AM] (vinayakumarb) HDFS-9337. Validate required params for WebHDFS requests (Contributed by [Nov 10, 2016 4:58:37 PM] (liuml07) HADOOP-13687. Provide a unified dependency artifact that transitively [Nov 10, 2016 10:08:51 PM] (kasha) YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares [Nov 10, 2016 10:35:12 PM] (epayne) YARN-4218. Metric for resource*time that was preempted. Contributed by [Nov 11, 2016 4:45:30 AM] (aajisaka) HDFS-6. Fix javac warnings caused by deprecation of APIs in [Nov 11, 2016 6:38:38 AM] (yzhang) HADOOP-12718. Incorrect error message by fs -put local dir without -1 overall The following subsystems voted -1: asflicense compile findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR hadoop.hdfs.server.datanode.checker.TestThrottledAsyncChecker hadoop.mapred.pipes.TestPipeApplication hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-compile-root.txt [404K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-compile-root.txt [404K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-compile-root.txt [404K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/whitespace-tabs.txt [1.3M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [208K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [88K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [316K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-ui.txt [136K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/222/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13809) hive: 'java.lang.IllegalStateException(zip file closed)'
Adriano created HADOOP-13809: Summary: hive: 'java.lang.IllegalStateException(zip file closed)' Key: HADOOP-13809 URL: https://issues.apache.org/jira/browse/HADOOP-13809 Project: Hadoop Common Issue Type: Bug Components: conf Affects Versions: 3.0.0-alpha1, 2.8.0 Environment: cdh5-2.6.0_5.7.4/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java Reporter: Adriano Randomly some of the hive queries are failing with the below exception on HS2: 2016-11-07 02:36:40,996 ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-1823748]: Ended Job = job_1478336955303_31030 with exception 'java.lang.IllegalStateException(zip file closed)' java.lang.IllegalStateException: zip file closed at java.util.zip.ZipFile.ensureOpen(ZipFile.java:634) at java.util.zip.ZipFile.getEntry(ZipFile.java:305) at java.util.jar.JarFile.getEntry(JarFile.java:227) at sun.net.www.protocol.jar.URLJarFile.getEntry(URLJarFile.java:128) at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:132) at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:150) at java.net.URLClassLoader.getResourceAsStream(URLClassLoader.java:233) at javax.xml.parsers.SecuritySupport$4.run(SecuritySupport.java:94) at java.security.AccessController.doPrivileged(Native Method) at javax.xml.parsers.SecuritySupport.getResourceAsStream(SecuritySupport.java:87) at javax.xml.parsers.FactoryFinder.findJarServiceProvider(FactoryFinder.java:283) at javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:255) at javax.xml.parsers.DocumentBuilderFactory.newInstance(DocumentBuilderFactory.java:121) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2526) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2503) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2409) at org.apache.hadoop.conf.Configuration.get(Configuration.java:982) at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2032) at org.apache.hadoop.mapred.JobConf.(JobConf.java:484) at org.apache.hadoop.mapred.JobConf.(JobConf.java:474) at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:210) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:596) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:594) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693) at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:594) at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:665) at org.apache.hadoop.mapred.JobClient.getReduceTaskReports(JobClient.java:689) at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:272) at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:549) at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:435) at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1770) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1527) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1306) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1115) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1108) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:178) at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:72) at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:232) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693) at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:245) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.co
[jira] [Created] (HADOOP-13810) Add a test to verify that Configuration handles &-encoded characters
Steve Loughran created HADOOP-13810:
---
Summary: Add a test to verify that Configuration handles &-encoded
characters
Key: HADOOP-13810
URL: https://issues.apache.org/jira/browse/HADOOP-13810
Project: Hadoop Common
Issue Type: Improvement
Components: test
Affects Versions: 2.7.3
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Minor
Add a quick test to verify that escaped/encoded chars like {{'}} are being
handled correctly. This is of course something all XML parsers need to do, but
it's always good to make sure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class
Steve Loughran created HADOOP-13811:
---
Summary: s3a: getFileStatus fails with
com.amazonaws.AmazonClientException: Failed to sanitize XML document destined
for handler class
Key: HADOOP-13811
URL: https://issues.apache.org/jira/browse/HADOOP-13811
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Affects Versions: 2.8.0
Reporter: Steve Loughran
Assignee: Steve Loughran
Sometimes, occasionally, getFileStatus() fails with a stack trace starting with
{{com.amazonaws.AmazonClientException: Failed to sanitize XML document destined
for handler class}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/ [Nov 10, 2016 4:58:37 PM] (liuml07) HADOOP-13687. Provide a unified dependency artifact that transitively [Nov 10, 2016 10:08:51 PM] (kasha) YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares [Nov 10, 2016 10:35:12 PM] (epayne) YARN-4218. Metric for resource*time that was preempted. Contributed by [Nov 11, 2016 4:45:30 AM] (aajisaka) HDFS-6. Fix javac warnings caused by deprecation of APIs in [Nov 11, 2016 6:38:38 AM] (yzhang) HADOOP-12718. Incorrect error message by fs -put local dir without [Nov 11, 2016 6:42:59 AM] (yzhang) HADOOP-13720. Add more info to the msgs printed in -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.crypto.key.kms.server.TestKMS hadoop.hdfs.TestEncryptedTransfer hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.tools.TestDelegationTokenFetcher hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestTokenClientRMService hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers hadoop.mapred.pipes.TestPipeApplication hadoop.mapreduce.TestMRJobClient Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-compile-root.txt [168K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-compile-root.txt [168K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-compile-root.txt [168K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-unit-hadoop-common-project_hadoop-kms.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [216K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/152/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservi
[jira] [Created] (HADOOP-13812) Upgrade Tomcat to 6.0.47 for security fixes
John Zhuge created HADOOP-13812: --- Summary: Upgrade Tomcat to 6.0.47 for security fixes Key: HADOOP-13812 URL: https://issues.apache.org/jira/browse/HADOOP-13812 Project: Hadoop Common Issue Type: Bug Components: kms Affects Versions: 2.6.0 Reporter: John Zhuge Assignee: John Zhuge Priority: Blocker KMS and HttpFS currently uses Tomcat 6.0.44. The latest version is 6.0.47, which has a bunch of security fixes: https://tomcat.apache.org/security-6.html -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13813) TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing
Mingliang Liu created HADOOP-13813:
--
Summary:
TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing
Key: HADOOP-13813
URL: https://issues.apache.org/jira/browse/HADOOP-13813
Project: Hadoop Common
Issue Type: Bug
Reporter: Mingliang Liu
Assignee: Mingliang Liu
[HADOOP-13720] added more info to the msgs printed in
{{AbstractDelegationTokenSecretManager}} for better supportability, which is
good. Unfortunately the unit test
{{TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer}} that asserts
the message string was not updated accordingly. The unit test is failing in
both {{trunk}} and {{branch-2}} branches, see example builds
[1|https://issues.apache.org/jira/browse/HDFS-11129?focusedCommentId=15657488&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15657488],
[2|https://issues.apache.org/jira/browse/HDFS-11130?focusedCommentId=15658086&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15658086],
and
[3|https://issues.apache.org/jira/browse/HDFS-7?focusedCommentId=15656939&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15656939].
This JIRA is to track the effort of fixing this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
