Re: Akka with Spark

Disha: Please consider these resources: https://groups.google.com/forum/#!forum/akka-user https://groups.google.com/forum/#!forum/akka-dev On Sun, Dec 27, 2015 at 5:15 AM, Dean Wampler wrote: > As Reynold said, you can still use Akka with Spark, but now it's more like > using any third-party li

Re: Akka with Spark

As Reynold said, you can still use Akka with Spark, but now it's more like using any third-party library that isn't already a Spark dependency (at least once the current Akka dependency is fully removed). Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition

Re: Akka with Spark

Hi All, I need an Akka like framework to implement model parallelism in neural networks, an architecture similar to that given in the link http://alexminnaar.com/implementing-the-distbelief-deep-neural-network-training-framework-with-akka.html. I need to divide a big neural network ( which can't f

Re: Akka with Spark

We are just removing Spark's dependency on Akka. It has nothing to do with whether user applications can use Akka or not. As a matter of fact, by removing the Akka dependency from Spark, it becomes easier for user applications to use Akka, because there is no more dependency conflict. For more inf

Re: Akka with Spark

Any rationale for removing Akka from Spark ? Also, what is the replacement ? Thanks > On Dec 27, 2015, at 8:31 AM, Dean Wampler wrote: > > Note that Akka is being removed from Spark. Even if it weren't, I would > consider keeping Akka processes separate from Spark processes, so you can >

Re: Akka with Spark

Note that Akka is being removed from Spark. Even if it weren't, I would consider keeping Akka processes separate from Spark processes, so you can monitor, debug, and scale them independently. So consider streaming data from Akka to Spark Streaming or go the other way, from Spark to Akka Streams. d

Re: Akka with Spark

Do you mind sharing your use case ? It may be possible to use a different approach than Akka. Cheers On Sat, Dec 26, 2015 at 10:08 AM, Disha Shrivastava wrote: > Hi, > > I wanted to know how to use Akka framework with Spark starting from > basics. I saw online that Spark uses Akka framework bu