[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188495760 **[Test build #2578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2578/consoleFull)** for PR 11342 at commit [`ecbd730`](https://

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11342 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188447440 **[Test build #2578 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2578/consoleFull)** for PR 11342 at commit [`ecbd730`](https://g

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188447316 LGTM, the tests actually passed (failed in SparkR), merging this into master, thanks! --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188338584 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188338573 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188337683 **[Test build #51879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51879/consoleFull)** for PR 11342 at commit [`ecbd730`](https://g

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188276579 **[Test build #51879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51879/consoleFull)** for PR 11342 at commit [`ecbd730`](https://gi

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188274034 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188173962 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188173956 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188173756 **[Test build #51859 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51859/consoleFull)** for PR 11342 at commit [`ecbd730`](https://g

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11342#discussion_r53912101 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -64,29 +58,37 @@ private[spark] class PythonRDD( val asJavaRDD: Jav

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188134065 looks good high level cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11342#discussion_r53905485 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -64,29 +58,37 @@ private[spark] class PythonRDD( val asJavaRDD: JavaRDD[

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188133086 **[Test build #51859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51859/consoleFull)** for PR 11342 at commit [`ecbd730`](https://gi

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-23 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11342#issuecomment-188129867 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-13467][pyspark] abstract python functio...

2016-02-23 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11342 [SPARK-13467][pyspark] abstract python function to simplify pyspark code ## What changes were proposed in this pull request? When we pass a Python function to JVM side, we also need to se