Github user bolkedebruin commented on the pull request:
https://github.com/apache/spark/pull/7489#issuecomment-122633600
Before adding the code I also grepped for getRMDelegationToken which is the
API call. It is not in Spark. Additionally, you are required to add it to the
launch context so where else can it be?
This was tested on a HDP 2.2.0 setup with FreeIPA as KDC/LDAP. It was also
tested on a HDP 2.2.6 clean install with Kerberos activated from
Ambari. We also tested with Spark 1.3.1. All are showing this behavior.
I might be able to test it with a CDH 5.3 cluster, but would you be able to
share a debug log yourself from the container to confirm that a RM token is
generated in your case and/or that behavior is different?
I would like to get to the bottom of this and as I said I was surprised it
wasn't in there before, but until now my data is saying so and I start to run
out of options to provide more evidence.
> On 19 jul. 2015, at 02:24, Hari Shreedharan <[email protected]>
wrote:
>
> I have not seen this issue. I am not saying RM is not running. I am saying
> there might be a config issue somewhere. I don't have access to the code
> right now, but I am fairly sure there is code that adds the RM tokens
> already.
>
> On Saturday, July 18, 2015, bolkedebruin <[email protected]> wrote:
>
> > @harishreedharan <https://github.com/harishreedharan> We tested it and
> > the issue is with both keytab and kinit. Why do you think the RM is not
> > running? As it is actually running (cluster is/was not doing much). The
> > "connection refused" message happens *after* the SASL negotiation fails
> > and is a bit misleading.
> >
> > See below for the same job but then with my patch included (will add in
on
> > minute).
> >
> > â
> > Reply to this email directly or view it on GitHub
> > <https://github.com/apache/spark/pull/7489#issuecomment-122580670>.
> >
>
>
> --
>
> Thanks,
> Hari
> â
> Reply to this email directly or view it on GitHub.
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
