uan
>
>
>
> *From: *Rong Rong
> *Date: *Sunday, January 12, 2020 at 6:13 PM
> *To: *Juan Gentile
> *Cc: *Aljoscha Krettek , "user@flink.apache.org" <
> user@flink.apache.org>, Arnaud Dufranne ,
> Oleksandr Nitavskyi
> *Subject: *Re: Yarn Kerberos is
d Dufranne , Oleksandr
Nitavskyi
Subject: Re: Yarn Kerberos issue
Hi Juan,
I have some time to dig deeper into the code, It seems like the
HADOOP_TOKEN_FILE_LOCATION is actually a static environment variable field that
the UserGroupInformation will read.
Interestingly Flink's Hadoop security
gt; >>>
> >
> > >>>
> >
> > >>> Thank you for your answer, the way we are trying to launch
> the job is
> >
> > >>> through a scheduler (similar to oozie) where we have a
> key
t;
> >>>
>
> >>> As a comparison, if I launch a spark job (without doing kinit)
just with
>
> >>> the delegation tokens, it works okay. So I guess Spark does
something
>
&
>>> something just not supported by Flink or I’m doing something wrong.
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Juan
>>>
>>>
>>>
>>> *From: *
Flink or I’m doing something wrong.
>>>
>>>
>>>
>>> Thank you,
>>>
>>> Juan
>>>
>>>
>>>
>>> *From: *Rong Rong
>>> *Date: *Saturday, January 4, 20
avskyi
*Subject: *Re: Yarn Kerberos issue
Hi Juan,
Chesnay was right. If you are using CLI to launch your session cluster
based on the document [1], you following the instruction to use kinit
[2]
first seems to be one of the right way to go.
Another way of approaching it is to setup the k
: *Chesnay Schepler
*Cc: *Juan Gentile , "user@flink.apache.org" <
user@flink.apache.org>, Oleksandr Nitavskyi
*Subject: *Re: Yarn Kerberos issue
Hi Juan,
Chesnay was right. If you are using CLI to launch your session cluster
based on the document [1], you following the instruction
>
> *From: *Rong Rong
> *Date: *Saturday, January 4, 2020 at 6:06 PM
> *To: *Chesnay Schepler
> *Cc: *Juan Gentile , "user@flink.apache.org" <
> user@flink.apache.org>, Oleksandr Nitavskyi
> *Subject: *Re: Yarn Kerberos issue
>
>
>
> Hi Juan,
>
&g
just not supported by Flink or I’m doing something wrong.
Thank you,
Juan
From: Rong Rong
Date: Saturday, January 4, 2020 at 6:06 PM
To: Chesnay Schepler
Cc: Juan Gentile , "user@flink.apache.org"
, Oleksandr Nitavskyi
Subject: Re: Yarn Kerberos issue
Hi Juan,
Chesnay was right.
Hi Juan,
Chesnay was right. If you are using CLI to launch your session cluster
based on the document [1], you following the instruction to use kinit [2]
first seems to be one of the right way to go.
Another way of approaching it is to setup the kerberos settings in the
flink-conf.yaml file [3]. F
From what I understand from the documentation, if you want to use
delegation tokens you always first have to issue a ticket using kinit;
so you did everything correctly?
On 02/01/2020 13:00, Juan Gentile wrote:
Hello,
Im trying to submit a job (batch worcount) to a Yarn cluster. I’m
trying
Hello,
Im trying to submit a job (batch worcount) to a Yarn cluster. I’m trying to use
delegation tokens and I’m getting the following error:
org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy
Yarn session cluster
at
org.apache.flink.yarn.AbstractYarn
13 matches
Mail list logo
