Hey Deb, Can you be specific what changes you are mentioning? We have not, to my knowledge, made major architectural changes around akka use.
I think in general we don't want people to be using Spark's actor system directly - it is an internal communication component in Spark and could e.g. be re-factored later to not use akka at all. Could you elaborate a bit more on your use case? - Patrick On Wed, Aug 20, 2014 at 9:02 AM, Debasish Das <debasish.da...@gmail.com> wrote: > Hi, > > There have been some recent changes in the way akka is used in spark and I > feel they are major changes... > > Is there a design document / JIRA / experiment on large datasets that > highlight the impact of changes (1.0 vs 1.1) ? Basically it will be great > to understand where akka is used in the code base... > > If I don't have to broadcast big variables but use akka's programming model > (use actors directly) on Spark's actorsystem is that allowed ? I understand > that it might look hacky :-) > > Thanks. > Deb >
