[GitHub] spark pull request: SPARK-1230: [WIP] Enable SparkContext.addJars(...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/119#issuecomment-37267178 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13108/ --- If your p

[GitHub] spark pull request: SPARK-1230: [WIP] Enable SparkContext.addJars(...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/119#issuecomment-37267177 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1230: [WIP] Enable SparkContext.addJars(...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/119#issuecomment-37267134 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37267128 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13107/ --- If your project i

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37267126 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: SPARK-1230: [WIP] Enable SparkContext.addJars(...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/119#issuecomment-37267133 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-1099:Spark's local mode should probably ...

Github user qqsun8819 commented on a diff in the pull request: https://github.com/apache/spark/pull/110#discussion_r10463110 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1204,7 +1204,7 @@ object SparkContext extends Logging { master match {

[GitHub] spark pull request: Spark-1163, Added missing Python RDD functions

Github user prabinb commented on the pull request: https://github.com/apache/spark/pull/92#issuecomment-37266566 Removed `RDD.generator()` and `RDD.setGenerator()` functions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1064

Github user gzm55 commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10462859 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -379,7 +381,17 @@ object ClientBase { // Based on code fro

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/86#issuecomment-37265429 https://github.com/apache/spark/pull/119 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: SPARK-782. Shade ASM

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-37265425 Can this be closed now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1230: [WIP] Enable SparkContext.addJars(...

GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/119 SPARK-1230: [WIP] Enable SparkContext.addJars() to load classes not in CLASSPATH Reopens and up-merges @velvia's patch previously against the old repo: https://github.com/apache/incubator-spark/

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37265019 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37265020 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37264923 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13105/ --- If your project i

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37264929 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37264922 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37264930 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13106/ --- If your project i

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37262869 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37262868 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: MLI-1 Decision Trees

Github user manishamde commented on a diff in the pull request: https://github.com/apache/spark/pull/79#discussion_r10461572 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/model/DecisionTreeModel.scala --- @@ -0,0 +1,58 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37262636 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: MLI-1 Decision Trees

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37262637 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: MLI-1 Decision Trees

Github user manishamde commented on a diff in the pull request: https://github.com/apache/spark/pull/79#discussion_r10461542 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/DecisionTree.scala --- @@ -0,0 +1,1055 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: MLI-1 Decision Trees

Github user manishamde commented on a diff in the pull request: https://github.com/apache/spark/pull/79#discussion_r10461519 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/tree/DecisionTree.scala --- @@ -0,0 +1,1055 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10461463 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -30,16 +32,23 @@ import org.apache.spark.scheduler._ * class, s

[GitHub] spark pull request: MLI-1 Decision Trees

Github user manishamde commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37262156 @mengxr Thanks for such a detailed review. The code is already in a much better shape after incorporating your suggested changes. I have fixed the straightforward code s

[GitHub] spark pull request: SPARK-1064

Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10460757 --- Diff: project/SparkBuild.scala --- @@ -236,7 +236,8 @@ object SparkBuild extends Build { "com.novocode" % "junit-interface" % "0.10" % "te

[GitHub] spark pull request: SPARK-1064

Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10459998 --- Diff: project/SparkBuild.scala --- @@ -236,7 +236,8 @@ object SparkBuild extends Build { "com.novocode" % "junit-interface" % "0.10" % "te

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/106 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-1168, Added foldByKey to pyspark.

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/115 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-977 Added Python RDD.zip function

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/76 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/118 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-972] Added detailed callsite info for V...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/34 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37257780 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13104/ --- If your project

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37257779 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1064

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10459709 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -379,7 +381,17 @@ object ClientBase { // Based on code

[GitHub] spark pull request: SPARK-1064

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10459510 --- Diff: project/SparkBuild.scala --- @@ -236,7 +236,8 @@ object SparkBuild extends Build { "com.novocode" % "junit-interface" % "0.10" %

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37255431 Here are some of your questions from the previous PR, let me answer inline: 1. *Based [SPARK-929] would it make sense to also include --spark-daemon-memory as an

[GitHub] spark pull request: SPARK-1064

Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10458903 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -379,7 +381,17 @@ object ClientBase { // Based on code fro

Re: Moving MLlib JIRA tickets to Spark

Done. The original urls should work as well, so you don't need to update the url in github. -Xiangrui On Mon, Mar 10, 2014 at 6:20 PM, Xiangrui Meng wrote: > Hi all, > > I'm going to move all MLlib JIRA tickets > (https://spark-project.atlassian.net/browse/MLLIB) to Spark because we > can migrate

[GitHub] spark pull request: SPARK-1064

Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10458859 --- Diff: project/SparkBuild.scala --- @@ -236,7 +236,8 @@ object SparkBuild extends Build { "com.novocode" % "junit-interface" % "0.10" % "te

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37254895 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37254896 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10458614 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterActor.scala --- @@ -50,6 +50,8 @@ class BlockManagerMasterActor(val isLocal: Boolean

Moving MLlib JIRA tickets to Spark

Hi all, I'm going to move all MLlib JIRA tickets (https://spark-project.atlassian.net/browse/MLLIB) to Spark because we can migrate only one project to Apache JIRA. Please create new MLlib JIRA tickets under Spark in the future and set the component to MLlib. Thanks, Xiangrui

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10458444 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -69,19 +100,55 @@ private[spark] class SparkUI(sc: SparkContext) extends Logging {

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10458380 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -69,19 +100,55 @@ private[spark] class SparkUI(sc: SparkContext) extends Logging {

[GitHub] spark pull request: [SPARK-1186] : Enrich the Spark Shell to suppo...

Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/116#issuecomment-37253813 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10458236 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -30,16 +32,23 @@ import org.apache.spark.scheduler._ * class

[GitHub] spark pull request: SPARK-1064

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10458176 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -379,7 +381,17 @@ object ClientBase { // Based on code

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10458118 --- Diff: core/src/main/scala/org/apache/spark/ui/UISparkListener.scala --- @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/117#issuecomment-37252898 Okay, sbt was able to fetch breeze_2.10-0.7-SNAPSHOT from Sonatype, so tests passed. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10457960 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -30,16 +32,23 @@ import org.apache.spark.scheduler._ * class, s

[GitHub] spark pull request: SPARK-1064

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10457935 --- Diff: pom.xml --- @@ -800,5 +800,40 @@ + + --- End diff -- A one liner comment here might be nice:

[GitHub] spark pull request: SPARK-1064

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/102#discussion_r10457908 --- Diff: project/SparkBuild.scala --- @@ -236,7 +236,8 @@ object SparkBuild extends Build { "com.novocode" % "junit-interface" % "0.10" %

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10457836 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -30,16 +32,23 @@ import org.apache.spark.scheduler._ * class, s

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/118#issuecomment-37252163 Hey Sandy - makes sense. I merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/118#issuecomment-37251642 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13102/ --- If your project

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37251639 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/118#issuecomment-37251641 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37251640 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13103/ --- If your project i

[GitHub] spark pull request: Spark-1163, Added missing Python RDD functions

Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/92#discussion_r10456929 --- Diff: python/pyspark/rdd.py --- @@ -1057,6 +1058,64 @@ def coalesce(self, numPartitions, shuffle=False): jrdd = self._jrdd.coalesce(numPartitio

[GitHub] spark pull request: Spark-1163, Added missing Python RDD functions

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/92#issuecomment-37250063 Other than removing the generator this looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: WIP - Upgrade Jetty to 9.1.3.v20140225.

Github user rxin commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37249125 Ok I think the cloduera repo is up. @tgravescs it would be great if you can try this. --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/118#issuecomment-37247891 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/117#issuecomment-37247880 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13101/ --- If your project

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37247913 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/118#issuecomment-37247892 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37247912 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/117#issuecomment-37247879 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37247719 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1211. In ApplicationMaster, set spark.ma...

GitHub user sryza opened a pull request: https://github.com/apache/spark/pull/118 SPARK-1211. In ApplicationMaster, set spark.master system property to "y... ...arn-cluster" You can merge this pull request into a Git repository by running: $ git pull https://github.com/sryza/sp

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37247451 Okay merging this now. Thanks Matei and Aaron for the feedback. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10455635 --- Diff: core/src/main/scala/org/apache/spark/ui/UISparkListener.scala --- @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-37244892 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Ability to initialize Spark-Shell with command...

Github user kellrott closed the pull request at: https://github.com/apache/spark/pull/109 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/117#issuecomment-37243343 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/117#issuecomment-37243346 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37243262 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13100/ --- If your project

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37243260 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/18#issuecomment-37240699 @holdenk do you mind creating a new JIRA under MLLib? MLI is a separate project/codebase than Spark. This is consistent with the other recent ML stuff. @mengxr in

[GitHub] spark pull request: [MLLIB-18] [WIP] Adding sparse data support an...

GitHub user mengxr opened a pull request: https://github.com/apache/spark/pull/117 [MLLIB-18] [WIP] Adding sparse data support and update KMeans Continue our discussions from https://github.com/apache/incubator-spark/pull/575 This PR is WIP because it depends on a SNAPSHOT

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37237367 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37237366 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: Principal Component Analysis

Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/88#discussion_r10450573 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/SVD.scala --- @@ -142,17 +155,138 @@ object SVD { val vsirdd = sc.makeRDD(Array.tabulate(V.r

[GitHub] spark pull request: WIP - Upgrade Jetty to 9.1.3.v20140225.

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37232830 Yeah the Cloudera repo is down today. I know the ops guys are figuring out why but don't see an ETA. While the repo ought to be, ahem, pretty reliable, it looks like it use

[GitHub] spark pull request: WIP - Upgrade Jetty to 9.1.3.v20140225.

Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37232635 @tgravescs the cloudera repo is down (I spoke with them) and they are trying to get it back up. --- If your project is set up for it, you can reply to this email and ha

Re: Please update the incubator status for the graduated podlings

Thanks for the nudge Roman. I believe I've covered all of the steps for Spark related to updating the Incubator tracking and removing the project, i.e., setting the status to "graduated", etc. TL;DR --- I just performed the following steps for Spark from the page you referenced: * Upd

[GitHub] spark pull request: SPARK-1162 Added top in python.

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/93#issuecomment-37232223 In particular note that you can use `heapq.heappushpop` to add each item and remove the smallest one when the heap reaches the required size. Before that, just use `heappush

[GitHub] spark pull request: SPARK-1162 Added top in python.

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/93#issuecomment-37231853 Hey Prashant, I looked at this but it seems that the Queue module in Python is used for thread-safe queues, meaning it will have a lot of unnecessary overhead for what we wa

[GitHub] spark pull request: SPARK-1102: Create a saveAsNewAPIHadoopDataset...

Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/12#issuecomment-37231038 No problem, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: SPARK-1168, Added foldByKey to pyspark.

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/115#issuecomment-37231009 Looks good, thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-972] Added detailed callsite info for V...

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/34#issuecomment-37230775 Sorry for the late reply; I've now merged this. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: WIP - Upgrade Jetty to 9.1.3.v20140225.

Github user rxin commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37230554 Yea unfortunately that's been the case for the past few days We should probably have another external repo to host artifacts only on cloudera repo to have some redundanc

[GitHub] spark pull request: WIP - Upgrade Jetty to 9.1.3.v20140225.

Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37230471 I generally use mvn to build. Right now I seem to be having issues building at all due to what appears like the cloudera repository being down. Error resolving

[GitHub] spark pull request: SPARK-977 Added Python RDD.zip function

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/76#issuecomment-37229918 Thanks Prabin; I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-1102: Create a saveAsNewAPIHadoopDataset...

Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/12#issuecomment-37229092 Sorry, haven't had time to look at this lately, but will do soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

Re: ALS solve.solvePositive

Choosing lambda = 0.1 shouldn't lead to the error you got. This is probably a bug. Do you mind sharing a small amount of data that can re-produce the error? -Xiangrui On Fri, Mar 7, 2014 at 8:24 AM, Debasish Das wrote: > Hi Xiangrui, > > I used lambda = 0.1...It is possible that 2 users ranked in

Re: Custom RDD

copy paste? Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Mon, Mar 10, 2014 at 12:30 PM, David Thomas wrote: > Is there any guide available on creating a custom RDD? >

  1   2   3   >