GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/1349
[SPARK-2423] Clean up SparkSubmit for readability
It is currently non-trivial to trace through how different combinations of
cluster managers (e.g. yarn) and deploy modes (e.g. cluster) are processed in
SparkSubmit. Moving forward, it will be easier to extend SparkSubmit if we
first re-organize the code by grouping related logic together. This is a
precursor to fixing standalone-cluster mode (SPARK-2260).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark submit-cleanup
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1349.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1349
----
commit 0b01ff86e56a9471acd52abc820e4bd98946eb36
Author: Andrew Or <[email protected]>
Date: 2014-07-09T20:12:05Z
Clean up SparkSubmit for readability
commit 7167824f6a3953dd037fb35d74f0c30384cf7cd1
Author: Andrew Or <[email protected]>
Date: 2014-07-09T21:44:34Z
Re-order config options and update comments
This also moves the code block for python applications back to the
right place.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
