Re: Nabble mailing list mirror errors: "This post has NOT been accepted by the mailing list yet"

Yesterday, I changed the domain name in the mailing list archive settings to remove ".incubator" so maybe it'll work now. However, I also sent two emails about this through the nabble interface (in this same thread) yesterday and they don't appear to have made it through so not sure if it actually

Fwd: 2014 Mesos community survey results

I think it's cool that the Mesos team did a survey of usage and published the aggregate results. It would be cool to do a survey for the Spark project and publish the results on the Spark website like the Mesos team did. -- Forwarded message -- From: "Dave Lester" Date: Jun 24, 201

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

quot;0" vote > > and no > > >>> "-1" vote. > > >>> > > >>> Thanks to everyone who tested the RC and voted. Here are the totals: > > >>> > > >>> +1: (13 votes) > > >>> Matei Zaharia* > > &g

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

+1 On May 28, 2014 7:05 PM, "Xiangrui Meng" wrote: > +1 > > Tested apps with standalone client mode and yarn cluster and client modes. > > Xiangrui > > On Wed, May 28, 2014 at 1:07 PM, Sean McNamara > wrote: > > Pulled down, compiled, and tested examples on OS X and ubuntu. > > Deployed app we a

Re: Scala examples for Spark do not work as written in documentation

I fixed the bug, but I kept the parameter "i" instead of "_" since that (1) keeps it more parallel to the python and java versions which also use functions with a named variable and (2) doesn't require readers to know this particular use of the "_" syntax in Scala. Thanks for catching this Glenn.

Re: can RDD be shared across mutil spark applications?

RDDs cannot currently be shared across multiple SparkContexts without using something like the Tachyon project (which is a separate project/codebase). Andy On May 16, 2014 2:14 PM, "qingyang li" wrote: > >

Re: Updating docs for running on Mesos

Thanks for suggesting this and volunteering to do it. On May 11, 2014 3:32 AM, "Andrew Ash" wrote: > > The docs for how to run Spark on Mesos have changed very little since > 0.6.0, but setting it up is much easier now than then. Does it make sense > to revamp with the below changes? > > > You n

Re: Link not working

Should be fixed now, thanks for reporting this! Andy On Mon, Apr 21, 2014 at 10:59 PM, prabeesh k wrote: > For Spark-0.8.0, the download links are not working. > > Please update the same > > Regarding, > prabeesh >

Updating all references to github.com/apache/incubator-spark on spark website

Since http://github.com/apache/incubator-spark and any links underneath it now return 404, I propose we do a global search and replace to change all instances to remove "incubator-", including those in docs/0.8.0 docs/0.8.1 and docs/0.9.0. I'm happy to do this. Any discussion before I do? Andy

Re: branch-1.0 cut

Wow, great work. Very impressive sticking to the schedule! On Wed, Apr 9, 2014 at 2:31 AM, Patrick Wendell wrote: > Hey All, > > In accordance with the scheduled window for the release I've cut a 1.0 > branch. Thanks a ton to everyone for being so active in reviews during the > last week. In th

Re: Calling Spark enthusiasts in NYC

ut London? >>> >>> >>> -- >>> Martin Goodson | VP Data Science >>> (0)20 3397 1240 >>> [image: Inline image 1] >>> >>> >>> On Mon, Mar 31, 2014 at 6:28 PM, Andy Konwinski >> > wrote: >>> >>>&g

Calling Spark enthusiasts in NYC

Hi folks, We have seen a lot of community growth outside of the Bay Area and we are looking to help spur even more! For starters, the organizers of the Spark meetups here in the Bay Area want to help anybody that is interested in setting up a meetup in a new city. Some amazing Spark champions ha

Re: The difference between driver and master Spark

The master is what monitors and manages jobs. It can be a master in a Spark standalone scheduler (which itself might be running inside of YARN) or a Mesos master. The driver is the program that the user interfaces with to talk to their Spark job. That communication is primarily dive through a Spar

[DISCUSS] Shepherding PRs

I thought this email exchange from the Mesos dev list was worth sharing. The Mesos project is trying out a process wherein they assign shepherds (who are committers) to significant issues. I'm not proposing that this necessarily makes sense for us, but I thought it might be worth discussing. Andy

Re: Please update the incubator status for the graduated podlings

Thanks for the nudge Roman. I believe I've covered all of the steps for Spark related to updating the Incubator tracking and removing the project, i.e., setting the status to "graduated", etc. TL;DR --- I just performed the following steps for Spark from the page you referenced: * Upd