[
https://issues.apache.org/jira/browse/FLINK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248500#comment-17248500
]
Huang Xingbo edited comment on FLINK-20568 at 12/13/20, 2:50 AM:
-----------------------------------------------------------------
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10827&view=logs&j=91bf6583-3fb2-592f-e4d4-d79d79c3230a&t=3425d8ba-5f03-540a-c64b-51b8481bf7d6]
It seems that `Kerberized YARN application on Docker` test timeout due to the
front test
`Kerberized YARN per-job on Docker test` failed with the similar problem
{code:java}
2020-12-12T23:08:11.6383411Z Dec 12 23:08:11 The program finished with the
following exception:
2020-12-12T23:08:11.6383722Z Dec 12 23:08:11
2020-12-12T23:08:11.6384149Z Dec 12 23:08:11
org.apache.flink.client.program.ProgramInvocationException: The main method
caused an error: Could not deploy Yarn job cluster.
2020-12-12T23:08:11.6384907Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330)
2020-12-12T23:08:11.6385512Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
2020-12-12T23:08:11.6386066Z Dec 12 23:08:11 at
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
2020-12-12T23:08:11.6386585Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743)
2020-12-12T23:08:11.6387084Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242)
2020-12-12T23:08:11.6387564Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971)
2020-12-12T23:08:11.6388079Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047)
2020-12-12T23:08:11.6388540Z Dec 12 23:08:11 at
java.security.AccessController.doPrivileged(Native Method)
2020-12-12T23:08:11.6388940Z Dec 12 23:08:11 at
javax.security.auth.Subject.doAs(Subject.java:422)
2020-12-12T23:08:11.6389426Z Dec 12 23:08:11 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1840)
2020-12-12T23:08:11.6390015Z Dec 12 23:08:11 at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
2020-12-12T23:08:11.6390575Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047)
2020-12-12T23:08:11.6391102Z Dec 12 23:08:11 Caused by:
org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy
Yarn job cluster.
2020-12-12T23:08:11.6391693Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:460)
2020-12-12T23:08:11.6392314Z Dec 12 23:08:11 at
org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70)
2020-12-12T23:08:11.6392976Z Dec 12 23:08:11 at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1940)
2020-12-12T23:08:11.6393633Z Dec 12 23:08:11 at
org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128)
2020-12-12T23:08:11.6394248Z Dec 12 23:08:11 at
org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76)
2020-12-12T23:08:11.6394866Z Dec 12 23:08:11 at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822)
2020-12-12T23:08:11.6395466Z Dec 12 23:08:11 at
org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96)
2020-12-12T23:08:11.6395932Z Dec 12 23:08:11 at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-12-12T23:08:11.6396383Z Dec 12 23:08:11 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-12-12T23:08:11.6396923Z Dec 12 23:08:11 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-12-12T23:08:11.6397413Z Dec 12 23:08:11 at
java.lang.reflect.Method.invoke(Method.java:498)
2020-12-12T23:08:11.6397886Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316)
2020-12-12T23:08:11.6398286Z Dec 12 23:08:11 ... 11 more
2020-12-12T23:08:11.6398839Z Dec 12 23:08:11 Caused by:
java.lang.RuntimeException: Hadoop security with Kerberos is enabled but the
login user does not have Kerberos credentials or delegation tokens!
2020-12-12T23:08:11.6399465Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:502)
2020-12-12T23:08:11.6400042Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:453)
2020-12-12T23:08:11.6400449Z Dec 12 23:08:11 ... 22 more
{code}
was (Author: hxbks2ks):
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10827&view=logs&j=91bf6583-3fb2-592f-e4d4-d79d79c3230a&t=3425d8ba-5f03-540a-c64b-51b8481bf7d6]
It seems that `Kerberized YARN application on Docker` test timeout due to the
front the test
`Kerberized YARN per-job on Docker test` with the similar problem
{code:java}
2020-12-12T23:08:11.6383411Z Dec 12 23:08:11 The program finished with the
following exception:
2020-12-12T23:08:11.6383722Z Dec 12 23:08:11
2020-12-12T23:08:11.6384149Z Dec 12 23:08:11
org.apache.flink.client.program.ProgramInvocationException: The main method
caused an error: Could not deploy Yarn job cluster.
2020-12-12T23:08:11.6384907Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330)
2020-12-12T23:08:11.6385512Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
2020-12-12T23:08:11.6386066Z Dec 12 23:08:11 at
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
2020-12-12T23:08:11.6386585Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743)
2020-12-12T23:08:11.6387084Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242)
2020-12-12T23:08:11.6387564Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971)
2020-12-12T23:08:11.6388079Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047)
2020-12-12T23:08:11.6388540Z Dec 12 23:08:11 at
java.security.AccessController.doPrivileged(Native Method)
2020-12-12T23:08:11.6388940Z Dec 12 23:08:11 at
javax.security.auth.Subject.doAs(Subject.java:422)
2020-12-12T23:08:11.6389426Z Dec 12 23:08:11 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1840)
2020-12-12T23:08:11.6390015Z Dec 12 23:08:11 at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
2020-12-12T23:08:11.6390575Z Dec 12 23:08:11 at
org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047)
2020-12-12T23:08:11.6391102Z Dec 12 23:08:11 Caused by:
org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy
Yarn job cluster.
2020-12-12T23:08:11.6391693Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:460)
2020-12-12T23:08:11.6392314Z Dec 12 23:08:11 at
org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70)
2020-12-12T23:08:11.6392976Z Dec 12 23:08:11 at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1940)
2020-12-12T23:08:11.6393633Z Dec 12 23:08:11 at
org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128)
2020-12-12T23:08:11.6394248Z Dec 12 23:08:11 at
org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76)
2020-12-12T23:08:11.6394866Z Dec 12 23:08:11 at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822)
2020-12-12T23:08:11.6395466Z Dec 12 23:08:11 at
org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96)
2020-12-12T23:08:11.6395932Z Dec 12 23:08:11 at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-12-12T23:08:11.6396383Z Dec 12 23:08:11 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-12-12T23:08:11.6396923Z Dec 12 23:08:11 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-12-12T23:08:11.6397413Z Dec 12 23:08:11 at
java.lang.reflect.Method.invoke(Method.java:498)
2020-12-12T23:08:11.6397886Z Dec 12 23:08:11 at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316)
2020-12-12T23:08:11.6398286Z Dec 12 23:08:11 ... 11 more
2020-12-12T23:08:11.6398839Z Dec 12 23:08:11 Caused by:
java.lang.RuntimeException: Hadoop security with Kerberos is enabled but the
login user does not have Kerberos credentials or delegation tokens!
2020-12-12T23:08:11.6399465Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:502)
2020-12-12T23:08:11.6400042Z Dec 12 23:08:11 at
org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:453)
2020-12-12T23:08:11.6400449Z Dec 12 23:08:11 ... 22 more
{code}
> Kerberized YARN per-job on Docker test failed with "Hadoop security with
> Kerberos is enabled but the login user does not have Kerberos credentials or
> delegation tokens!"
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-20568
> URL: https://issues.apache.org/jira/browse/FLINK-20568
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.11.0, 1.12.0, 1.13.0
> Reporter: Huang Xingbo
> Priority: Major
> Labels: test-stability
>
> Instance on 1.11 branch
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10780&view=logs&j=08866332-78f7-59e4-4f7e-49a56faa3179&t=3e8647c1-5a28-5917-dd93-bf78594ea994]
> {code:java}
> 2020-12-10T22:38:25.1087443Z The program finished with the following
> exception:
> 2020-12-10T22:38:25.1087688Z
> 2020-12-10T22:38:25.1088094Z
> org.apache.flink.client.program.ProgramInvocationException: The main method
> caused an error: Could not deploy Yarn job cluster.
> 2020-12-10T22:38:25.1088717Z at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
> 2020-12-10T22:38:25.1089321Z at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
> 2020-12-10T22:38:25.1090233Z at
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
> 2020-12-10T22:38:25.1090749Z at
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
> 2020-12-10T22:38:25.1091233Z at
> org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
> 2020-12-10T22:38:25.1091705Z at
> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
> 2020-12-10T22:38:25.1092225Z at
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
> 2020-12-10T22:38:25.1095464Z at
> java.security.AccessController.doPrivileged(Native Method)
> 2020-12-10T22:38:25.1095961Z at
> javax.security.auth.Subject.doAs(Subject.java:422)
> 2020-12-10T22:38:25.1096436Z at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1840)
> 2020-12-10T22:38:25.1097027Z at
> org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> 2020-12-10T22:38:25.1097859Z at
> org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
> 2020-12-10T22:38:25.1098474Z Caused by:
> org.apache.flink.client.deployment.ClusterDeploymentException: Could not
> deploy Yarn job cluster.
> 2020-12-10T22:38:25.1099065Z at
> org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:431)
> 2020-12-10T22:38:25.1099674Z at
> org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70)
> 2020-12-10T22:38:25.1100918Z at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1818)
> 2020-12-10T22:38:25.1101607Z at
> org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128)
> 2020-12-10T22:38:25.1102202Z at
> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76)
> 2020-12-10T22:38:25.1102840Z at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1700)
> 2020-12-10T22:38:25.1103467Z at
> org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96)
> 2020-12-10T22:38:25.1104174Z at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2020-12-10T22:38:25.1104638Z at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2020-12-10T22:38:25.1105174Z at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2020-12-10T22:38:25.1105645Z at
> java.lang.reflect.Method.invoke(Method.java:498)
> 2020-12-10T22:38:25.1106119Z at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
> 2020-12-10T22:38:25.1106495Z ... 11 more
> 2020-12-10T22:38:25.1106940Z Caused by: java.lang.RuntimeException: Hadoop
> security with Kerberos is enabled but the login user does not have Kerberos
> credentials or delegation tokens!
> 2020-12-10T22:38:25.1107584Z at
> org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:475)
> 2020-12-10T22:38:25.1108484Z at
> org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424)
> 2020-12-10T22:38:25.1109201Z ... 22 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
