What is the correct Spark version of master/branch-1.0?

Hi all, I'm wondering what is the correct Spark version of each HEAD of master and branch-1.0. current master HEAD (e8d93ee5284cb6a1d4551effe91ee8d233323329): - pom.xml: 1.0.0-SNAPSHOT - SparkBuild.scala: 1.1.0-SNAPSHOT It should be 1.1.0-SNAPSHOT? current branch-1.0 HEAD (d96794132e37cf57f8dd

Re: collectAsMap doesn't return a multiMap?

Yup, it’s meant to be just a Map. You should probably use collect() and build a multimap instead if you’d like that. Matei On Jun 3, 2014, at 2:08 PM, Doris Xin wrote: > Hey guys, > > Just wanted to check real quick if collectAsMap was by design not to > return a multimap (so multiple values

Re: Eclipse Scala IDE/Scala test and Wiki

I was able to edit the page and add Eclipse setup steps. Thanks Matei and Reynold! - -- Madhu https://www.linkedin.com/in/msiddalingaiah -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Eclipse-Scala-IDE-Scala-test-and-Wiki-tp6908p6930.html Sent fr

collectAsMap doesn't return a multiMap?

Hey guys, Just wanted to check real quick if collectAsMap was by design not to return a multimap (so multiple values to the same key can overwrite the same entry). It seems like it's only used in some unit tests in the codebase. I added a warning in the comment saying not to expect a multimap. Let

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

I think I lost that permission too? Patrick once helped to recover the permission, but I lost that permission again? username is CodingCat, or Nan Zhu (I’m not sure which one you use when doing this)? Best, -- Nan Zhu On Tuesday, June 3, 2014 at 2:39 PM, Henry Saputra wrote: > Thanks

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

Same here please, username (kzhang). Thanks! On Tue, Jun 3, 2014 at 11:39 AM, Henry Saputra wrote: > Thanks Matei! > > - Henry > > On Tue, Jun 3, 2014 at 11:36 AM, Matei Zaharia > wrote: > > Done. Looks like this was lost in the JIRA import. > > > > Matei > > > > On Jun 3, 2014, at 11:33 AM, H

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

Thanks Matei! - Henry On Tue, Jun 3, 2014 at 11:36 AM, Matei Zaharia wrote: > Done. Looks like this was lost in the JIRA import. > > Matei > > On Jun 3, 2014, at 11:33 AM, Henry Saputra wrote: > >> Hi, >> >> Could someone with right karma kindly add my username (hsaputra) to >> Spark's contribu

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

Done. Looks like this was lost in the JIRA import. Matei On Jun 3, 2014, at 11:33 AM, Henry Saputra wrote: > Hi, > > Could someone with right karma kindly add my username (hsaputra) to > Spark's contributor list? > > I was added before but somehow now I can no longer assign ticket to > myself

Add my JIRA username (hsaputra) to Spark's contributor's list

Hi, Could someone with right karma kindly add my username (hsaputra) to Spark's contributor list? I was added before but somehow now I can no longer assign ticket to myself nor update tickets I am working on. Thanks, - Henry

Re: Removing spark-debugger.md file from master?

Cool, thanks Ankur, sounds good. PR is coming. - Henry On Tue, Jun 3, 2014 at 11:11 AM, Ankur Dave wrote: > I agree, let's go ahead and remove it. > > Ankur

Re: Removing spark-debugger.md file from master?

I agree, let's go ahead and remove it. Ankur

Removing spark-debugger.md file from master?

Hi All, Seemed like the spark-debugger.md is no longer accurate (see http://spark.apache.org/docs/latest/spark-debugger.html) and since it was originally written Spark has evolved that makes the doc obsolete. There are already work pending for new replay debugging (I could not find the PR links f

Re: SCALA_HOME or SCALA_LIBRARY_PATH not set during build

Cool. Nice to not have to set this any more. best, Colin On Sun, Jun 1, 2014 at 11:21 AM, Patrick Wendell wrote: > I went ahead and created a JIRA for this and back ported the > improvement into branch-1.0. This wasn't a regression per-se because > the behavior existed in all previous version

sbt run with spark.ContextCleaner ERROR

This was posted before, but I couldn't find an answer (http://mail-archives.apache.org/mod_mbox/incubator-spark-user/201405.mbox/%3c1399196458177-5304.p...@n3.nabble.com%3E) i use sbt to run my spark application, after the app completes, error occurs: 14/05/04 17:32:28 INFO network.ConnectionMa