[
https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882027#comment-15882027
]
Saisai Shao commented on SPARK-19688:
-------------------------------------
According to my test, "spark.yarn.credentials.file" will be overwritten in
yarn-client to point to a correct path when launching application
(https://github.com/apache/spark/blob/master/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala#L737).
So even Spark Streaming checkpoint still keeps the old configuration, it will
be overwritten when the new application is started. So I don't see an issue
here except this weird setting.
> Spark on Yarn Credentials File set to different application directory
> ---------------------------------------------------------------------
>
> Key: SPARK-19688
> URL: https://issues.apache.org/jira/browse/SPARK-19688
> Project: Spark
> Issue Type: Bug
> Components: DStreams, YARN
> Affects Versions: 1.6.3
> Reporter: Devaraj Jonnadula
> Priority: Minor
>
> spark.yarn.credentials.file property is set to different application Id
> instead of actual Application Id
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
