GitHub user jongyoul reopened a pull request:
https://github.com/apache/incubator-zeppelin/pull/118
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- Spark supports pyspark on yarn cluster without deploying python libraries
from Spark 1.4
- https://issues.apache.org/jira/browse/SPARK-6869
- apache/spark#5580, apache/spark#5478
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jongyoul/incubator-zeppelin ZEPPELIN-18
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-zeppelin/pull/118.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #118
----
commit 4a24907063504171f38162a51e1fb7461eb9a305
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-25T05:33:15Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- rebasing
commit 3fa2642091ee6e447ed2d6449911883fc4eb68ff
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-21T03:27:18Z
[ZEPPELIN-18] Remove setting SPARK_HOME for PySpark
- Removed redundant dependency setting
commit 2f1e3d8a04847584bdba416f4ebefe468f352941
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-24T06:08:12Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- Followed spark's way to support pyspark
- https://issues.apache.org/jira/browse/SPARK-6869
- https://github.com/apache/spark/pull/5580
- https://github.com/apache/spark/pull/5478/files
commit 929a67cd3e8b23a07ebb98e77dfb09525eb7efb7
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-24T06:29:01Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- Removed verbose setting
commit a474fc6eaf5e08054f90293e466e1cc1c1761935
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-24T10:32:29Z
[ZEPPELIN-18] Remove setting SPARK_HOME for PySpark
- Excludes python/** from apache-rat
commit 987682b6c7c9ddf22f353e0be126f60090db4941
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:39:03Z
rebased
commit bfcd8a08e5d670639be100ceb1ab122b5ff26fee
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-25T05:35:04Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- rebasing
commit 282f8e59e36da2ef0d126cce0ccd3725e3aa541e
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:40:32Z
rebased
commit f5af0d66e5ec22392b0625faac7f6abd04c72377
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-24T16:33:14Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- Fixed checkstyle
commit 4449413032f67de391dadec7400b37e0745dc91f
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:41:11Z
rebased
commit 4de7f3b90a68c836d5e8a55b797179ed2026d6a5
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-25T05:37:34Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- rebasing
commit 17f6132031645e5e3bae810d3f4489c79b030a2a
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:41:39Z
rebased
commit 6a82b042f2f07f6a478927c2a5b4e83bbc1b2137
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-25T03:04:37Z
[ZEPPELIN-18] Running pyspark without deploying python libraries to every
yarn node
- Dummy for trigger
commit f2b9355f1b1ce1b8e9c33d229bb3219d55d77b32
Author: Jongyoul Lee <[email protected]>
Date: 2015-06-29T14:50:25Z
- Fixed typo
commit 2812a771bef59e5af95fb52054167f34728e39a0
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-02T09:01:58Z
- Fixed typo
commit 25c70b0bfcb30ef36feffd564dd73bbc97e6844f
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:28:54Z
- Removed setting SPARK_HOME
- Changed the location of pyspark's directory into interpreter/spark
commit 8224e1ae4134d43fba518d7a61a7202fb97c1964
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:29:45Z
- Removed meaningless codes comments
commit 203d866f0b376f1bb979b06c03c950246a9b9ae7
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:49:36Z
- Cleanup codes
commit 6a2930d17f0accf4700be034537393a6919cf166
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T03:50:41Z
- Cleanup codes
commit c477ba911156ec3d6b86c0942e00cc87af674177
Author: Jongyoul Lee <[email protected]>
Date: 2015-07-03T07:25:44Z
- Cleanup codes
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
