ng?
Checking to see if you provide a keytab and principal in your invocation.
-
Neelesh S. Salian
Cloudera
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Creating-new-Spark-context-when-running-in-Secure-YARN-fails-tp25361p26873.html
Sent from the Apache
ubmit.deployMode', u'client'), (u'spark.ssl.enabled',
> u'true'), (u'spark.authenticate', u'true'), (u'spark.ssl.trustStore',
> u'xxx.truststore')]
>
> I am not really familiar with "spark
k.ssl.enabled',
> u'true'), (u'spark.authenticate', u'true'), (u'spark.ssl.trustStore',
> u'xxx.truststore')]
>
> I am not really familiar with "spark.yarn.credentials.file" and had
> thought it was created automatically a
parkContext()
Same error dump as below.
Do I need to pass something to the new sparkcontext ?
Thanks,
Mike
Inactive hide details for Ted Yu ---11/11/2015 01:55:02 PM---Looks like
the delegation token should be renewed. Mind trying theTed Yu
---11/11/2015 01:55:02 PM---Looks like
l.java:57)
>at
>
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>at
>java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>at py4j.reflection.MethodInvoker.invoke(MethodInvok
Michael V Le/Watson/IBM@IBMUS
Cc: user
Date: 11/11/2015 01:55 PM
Subject:Re: Creating new Spark context when running in Secure YARN
fails
Looks like the delegation token should be renewed.
Mind trying the following ?
Thanks
diff --git
a/yarn/src/main/scala/org/
oke(ReflectionEngine.java:379)
> at py4j.Gateway.invoke(Gateway.java:214)
> at
>
> py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
> at
> py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
> at py4j
:745)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Creating-new-Spark-context-when-running-in-Secure-YARN-fails-tp25361.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
