Github user sryza commented on the pull request:
https://github.com/apache/spark/pull/586#issuecomment-41645734
Uploaded a patch that follows your comments. I tested it against YARN and
verified that the opts and environment variables both show up.
Right now when I try running spark-shell with your Java opt string, I get a
java.lang.NoClassDefFoundError: App". It seems like spark-class isn't able to
handle it, which is at least reassuring that we're not breaking previous
behavior. I haven't tried yet to think more generally about whether there are
strings that would work for spark-class but not work with the Spark YARN code.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---