How is Spark built on top of the Akka framework?

2016-01-29 Thread Lorena Reis
Hi all, I'd like to know, how is Spark built on top of the Akka framework? Are there information about that? Thanks in advance.

Re: How is Spark built on top of the Akka framework?

2016-01-29 Thread Reynold Xin
As of Spark 2.0 (not yet released), Spark does not use Akka any more. See https://issues.apache.org/jira/browse/SPARK-5293 On Fri, Jan 29, 2016 at 1:14 AM, Lorena Reis wrote: > Hi all, > > I'd like to know, how is Spark built on top of the Akka framework? Are > there information about that? > >

Re: Adding Naive Bayes sample code in Documentation

2016-01-29 Thread Joseph Bradley
JIRA created! https://issues.apache.org/jira/browse/SPARK-13089 Feel free to pick it up if you're interested. : ) Joseph On Wed, Jan 27, 2016 at 8:43 AM, Vinayak Agrawal wrote: > Hi, > I was reading through Spark ML package and I couldn't find Naive Bayes > examples documented on the spark doc

Re: Spark 2.0.0 release plan

2016-01-29 Thread Jakob Odersky
I'm not an authoritative source but I think it is indeed the plan to move the default build to 2.11. See this discussion for more detail http://apache-spark-developers-list.1001551.n3.nabble.com/A-proposal-for-Spark-2-0-td15122.html On Fri, Jan 29, 2016 at 11:43 AM, Deenar Toraskar wrote: > A re

Re: Spark 2.0.0 release plan

2016-01-29 Thread Michael Armbrust
Its already underway: https://github.com/apache/spark/pull/10608 On Fri, Jan 29, 2016 at 11:50 AM, Jakob Odersky wrote: > I'm not an authoritative source but I think it is indeed the plan to > move the default build to 2.11. > > See this discussion for more detail > > http://apache-spark-develop

Re: Spark 2.0.0 release plan

2016-01-29 Thread Mark Hamstra
https://github.com/apache/spark/pull/10608 On Fri, Jan 29, 2016 at 11:50 AM, Jakob Odersky wrote: > I'm not an authoritative source but I think it is indeed the plan to > move the default build to 2.11. > > See this discussion for more detail > > http://apache-spark-developers-list.1001551.n3.na

Re: Spark 1.6.1

2016-01-29 Thread deenar
Hi Michael The Dataset aggregators do not appear to support complex Spark-SQL types. I wasn't sure if I was doing something wrong or if this was a bug or a feature not implemented yet. Having this in would be great. See below (reposting this from the spark user list) https://docs.cloud.databricks

Re: Spark 1.6.1

2016-01-29 Thread Michael Armbrust
I think this is fixed in branch-1.6 already. If you can reproduce it there can you please open a JIRA and ping me? On Fri, Jan 29, 2016 at 12:16 PM, deenar < deenar.toras...@thinkreactive.co.uk> wrote: > Hi Michael > > The Dataset aggregators do not appear to support complex Spark-SQL types. I >