TorrentBroadcast is actually slightly simpler, but it’s based on that. It has similar performance. I’d like to make it the default in a future version, we just haven’t had a ton of testing with it yet (kind of an oversight in this release unfortunately).
Matei On May 19, 2014, at 12:07 AM, Andrew Ash <and...@andrewash.com> wrote: > Hi Spark devs, > > Is the algorithm for > TorrentBroadcast<https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala>the > same as Cornet from the below paper? > > http://www.mosharaf.com/wp-content/uploads/orchestra-sigcomm11.pdf > > If so it would be nice to include a link to the paper in the Javadoc for > the class. > > Thanks! > Andrew
