Hey Tom, > I'll pull [SPARK-1053] Should not require SPARK_YARN_APP_JAR when running on > YARN - JIRA and [SPARK-1051] On Yarn, executors don't doAs as submitting > user - JIRA in. The pyspark one I would consider more of an enhancement so > might not be appropriate for a point release.
Someone recently sent me a personal e-mail reporting some problems with this. I'll ask them to forward it to you/the dev list. Might be worth looking into before merging. > [SPARK-1051] On Yarn, executors don't doAs as submitting user - JIRA > This means that they can't write/read from files that the yarn user doesn't > have permissions to but the submitting user does. > View on spark-project.atlassian.net Preview by Yahoo Good call on this one. - Patrick