AW: Broadcast data sent increases with # slots per TM

2016-06-08 Thread Kunft, Andreas
er to optimize the BC sets. Currently, there is nobody working on it. If you want to start working on it, then I would recommend to open a JIRA and start writing a design document for it. Cheers, Till On Wed, Jun 8, 2016 at 1:45 PM, Kunft, Andreas wrote: > Hi, > > > we experienc

Broadcast data sent increases with # slots per TM

2016-06-08 Thread Kunft, Andreas
Hi, we experience some unexpected increase of data sent over the network for broadcasts with increasing number of slots per Taskmanager. We provided a benchmark [1]. It not only increases the size of data sent over the network but also hurts performance as seen in the preliminary results bel

AW: FastR-Flink: a new open source Truffle project

2015-10-27 Thread Kunft, Andreas
or sharing. I will try it out :-) > > > > On Thursday, October 22, 2015, Kunft, Andreas < > andreas.ku...@tu-berlin.de> > > wrote: > > > > > FYI: > > > > > > > > > FastR on Flink, a project to combine the R pro

FastR-Flink: a new open source Truffle project

2015-10-22 Thread Kunft, Andreas
FYI: FastR on Flink, a project to combine the R programming language with Flink, just went open source: http://mail.openjdk.java.net/pipermail/graal-dev/2015-October/003728.html? Best Andreas