[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36598821 It does not cover the case if JAVA_HOME points to invalid directory, it will simply takes alternate path instead of failing nicely. --- If your project is set up for it

[GitHub] spark pull request: SPARK-964 Fix for -java-home note.

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36598490 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36598429 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36598427 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36598229 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36598228 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36598072 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36598073 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12985/ --- If your project i

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/71#issuecomment-36597306 @pwendell Hey Patrick, It might be good to have jenkins not test the PRs which start with [WIP] or WIP. Or something like that ? --- If your project is set up for it, y

[GitHub] spark pull request: [WIP] SPARK-964 Fix for -java-home note.

2014-03-03 Thread ScrapCodes
GitHub user ScrapCodes opened a pull request: https://github.com/apache/spark/pull/71 [WIP] SPARK-964 Fix for -java-home note. I just did a manual testing of this. with -java-home "jdk", setting just JAVA_HOME and both. Hope it covers all cases. It is work in prog

Re: MLLib - Thoughts about refactoring Updater for LBFGS?

2014-03-03 Thread DB Tsai
Hi Deb, I had tried breeze L-BFGS algorithm, and when I tried it couple weeks ago, it's not as stable as the fortran implementation. I guessed the problem is in the line search related thing. Since we may bring breeze dependency for the sparse format support as you pointed out, we can just try to

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/63#discussion_r1026 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -125,14 +126,17 @@ class CoarseGrainedScheduler

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36595932 @ScrapCodes hey sure feel free to submit a follow on PR. I'm going to merge this for now. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36595760 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36595762 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36595569 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36595570 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12984/ --- If your project i

[GitHub] spark pull request: Remove broken/unused Connection.getChunkFIFO m...

2014-03-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/69 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: SPARK-1158: Fix flaky RateLimitedOutputStreamS...

2014-03-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/55 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36594377 There is one thing to note, `-java-home` currently has a note, we can actually fix that. In the sense by moving check after process args. --- If your project is set up

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/18#discussion_r10243724 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/util/MLUtilsSuite.scala --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread benh
Github user benh commented on a diff in the pull request: https://github.com/apache/spark/pull/60#discussion_r10243718 --- Diff: docs/configuration.md --- @@ -134,6 +134,22 @@ Apart from these, the following properties are also available, and may be useful +

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/18#discussion_r10243710 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -17,12 +17,17 @@ package org.apache.spark.mllib.util +import

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread benh
Github user benh commented on a diff in the pull request: https://github.com/apache/spark/pull/60#discussion_r10243692 --- Diff: docs/running-on-mesos.md --- @@ -15,13 +15,15 @@ Spark can run on clusters managed by [Apache Mesos](http://mesos.apache.org/). F * `export MESOS

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36594079 Looks good to me too. I read through the updated docs and build instructions. --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: Spark 615 map partitions with index callable f...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/16#issuecomment-36593941 Hey Holden, wait on this a bit until https://github.com/apache/spark/pull/17 is merged. Then we'll also want to make sure it works with Java 8 (you'll need to make the class

[GitHub] spark pull request: Fixed API docs link in Python programming guid...

2014-03-03 Thread jyotiska
Github user jyotiska closed the pull request at: https://github.com/apache/spark/pull/67 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-1145: Memory mapping with many small blo...

2014-03-03 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/43#discussion_r10243564 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockFetcherIterator.scala --- @@ -146,6 +146,12 @@ object BlockFetcherIterator { }

[GitHub] spark pull request: SPARK-1156: allow user to login into a cluster...

2014-03-03 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/58#discussion_r10243513 --- Diff: ec2/spark_ec2.py --- @@ -680,6 +678,9 @@ def real_main(): opts.zone = random.choice(conn.get_all_zones()).name if action == "launc

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/60#discussion_r10243489 --- Diff: docs/running-on-mesos.md --- @@ -15,13 +15,15 @@ Spark can run on clusters managed by [Apache Mesos](http://mesos.apache.org/). F * `export MES

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/60#discussion_r10243444 --- Diff: docs/configuration.md --- @@ -134,6 +134,22 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/63#issuecomment-36593562 @kayousterhout @markhamstra @andrewor14 Thank you for your comments, I updated the code, how about this? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: Fixed API docs link in Python programming guid...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/67#issuecomment-36593463 Maybe there was temporarily a wrong version of the docs published -- we republished them recently. But the links seem to work now, so I think it's fine to close the PR. --

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243399 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: Remove broken/unused Connection.getChunkFIFO m...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/69#issuecomment-36593399 I've merged this, thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1158: Fix flaky RateLimitedOutputStreamS...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/55#issuecomment-36593259 Looks good to me. I'm going to merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243307 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36593221 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36593222 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/63#issuecomment-36593192 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/63#issuecomment-36593193 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12982/ --- If your project i

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/50#discussion_r10243269 --- Diff: core/src/main/scala/org/apache/spark/CacheManager.scala --- @@ -71,10 +71,21 @@ private[spark] class CacheManager(blockManager: BlockManager) extends L

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243179 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243090 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36592033 @matiez this looks good to me. Any final thoughts? If not I'll merge this in a bit. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242829 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36591694 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36591029 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12983/ --- If your pr

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36591028 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-36590957 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12980/ --- If your project i

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/63#issuecomment-36590961 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/18#issuecomment-36590956 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12981/ --- If your project i

[GitHub] spark pull request: [Proposal] SPARK-1171: simplify the implementa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/63#issuecomment-36590962 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36590966 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/18#issuecomment-36590954 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36590967 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-36590955 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36590950 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36590951 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12979/ --- If your project i

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242460 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242393 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242279 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242223 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allowLo

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242213 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10242185 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: SPARK-1156: allow user to login into a cluster...

2014-03-03 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/58#issuecomment-36590068 I updated the code and tested the functionalities, everything goes well --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: Remove the remoteFetchTime metric.

2014-03-03 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/62#issuecomment-36589314 I think I just threw a bunch of different metrics together, I don't think this one was ever that useful. It would be nice to have something to measure bandwidth, but I gues

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10241868 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allow

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-36588480 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-36588479 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/18#issuecomment-36588483 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/18#issuecomment-36588482 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36588476 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36588475 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36588452 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36588453 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12977/ --- If your project i

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36588451 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36588454 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12978/ --- If your pr

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36588448 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36588449 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12976/ --- If your project i

[GitHub] spark pull request: MLI-2: Start adding k-fold cross validation to...

2014-03-03 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18#discussion_r10241454 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -62,6 +67,20 @@ object MLUtils { } /** + * Return a k e

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread iven
Github user iven commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36586768 Done. Please correct me if there's any mistake in my pool English. :D --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36586256 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36586257 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10240683 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -17,38 +17,80 @@ package org.apache.spark.ui +import java.io.{File

[GitHub] spark pull request: Updated the formatting of code blocks using Gi...

2014-03-03 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/68#issuecomment-36586048 I was meaning to ask about this. Can we do something to display the docs properly on both Github and website? I was bothered by how ugly the code snippets look when Github

[GitHub] spark pull request: Fixed API docs link in Python programming guid...

2014-03-03 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/67#issuecomment-36585916 I understand. Actually, all these links in Python programming guide was throwing 404. Not sure if this is only with me, but if the links are working fine for you I will cl

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36585637 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36585642 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [java8API] SPARK-964 Investigate the potential...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/17#issuecomment-36585641 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Update building-with-maven.md

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/70#issuecomment-36585631 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/44#issuecomment-36585638 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: Update building-with-maven.md

2014-03-03 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/70 Update building-with-maven.md mvn -Dhadoop.version=... -Dsuites=spark.repl.ReplSuite test to mvn -Dhadoop.version=... -Dsuites=org.apache.spark.repl.ReplSuite test You can me

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10239640 --- Diff: core/src/main/scala/org/apache/spark/ui/UISparkListener.scala --- @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[GitHub] spark pull request: [WIP] [SPARK-1132] Persisting Web UI through r...

2014-03-03 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/42#discussion_r10239648 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -17,38 +17,80 @@ package org.apache.spark.ui +import java.io.{File

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-03 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-36583145 Ah, got it. In that case please expand the doc for the spark.mesos.checkpoint entry to explain that, and maybe link to the corresponding Mesos docs. Otherwise the current de

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10239276 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int], allowLoca

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36582785 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Patch for SPARK-942

2014-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/50#issuecomment-36582786 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12975/ --- If your pr

  1   2   3   >